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Summary of Progress 


In this report, we will focus on the results included in the Ph.D. dissertation of Dr. Diane 
G. Mills. Dr. Mills completed her dissertation and received her Ph.D. degree in August 1994. 
A copy of the dissertation is included as Appendix A to this report. Two journal papers have 
been submitted based on Dr. Mills’ research [1,2]. In addition, three conference presentations 
have resulted from this work [3-5]. The following paragraphs contain a brief summary of this 
research. 

The purpose of unequal error protection (UEP) is to provide a higher degreee of error 
protection for the more important bits, without incurring the associated increase in complex- 
ity/cost/bandwidth that would occur if the protection were increased for the entire information 
stream. For example, UEP coding can be used to transmit images over noisy channels where 
different parts of an image require different levels of error protection. A potential application 
is the transmission of images over NASA’s deep space network. The goal of this research was 
to investigate the unequal error protection capabilities of convolutional codes and to extend 
the results to trellis codes. 

First, the effective free distance vector, d, was defined as an alternative to the freedistance 
as a primary performance parameter for UEP convolutional encoders. For a given ( n,k,m ) 
convolutional encoder the effective free distance vector is defined as the fc-dimensional vector 
d = (d 0 , dj, • • • ,dk~ i), where dj, the j th effective free distance, is the lowest Hamming weight 
among all code sequences that are generated by input sequences with at least one “1” in the 
j th position. It is evident that the free distance of the code is the minimum of the effective free 
distances. Although the free distance for a code is unique to the code and independent of the 
encoder realization, the effective free distance vector is dependent on the encoder realization. 

A modified transfer function, which provides a method to calculate d, was developed. The 
modified transfer function incorporates a new branch labeling method which may be used to 
calculate the effective free distance vector when used in conjunction with standard algorithms 
that were originally developed to calculate the free distance of a code. 

Several upper bounds on the effective free distance vector were derived. The bounds may 
be used to identify encoder configurations that have good potential for unequal error protec- 
tion. Then computer searches for good unequal error protection encoders were conducted. 
A primary goal of the searches was to find encoders with at least one effective free distance 
greater than the free distance of the optimal code of the same rate and memory order. A 
decrease in free distance was acceptable. A number of binary convolutional encoders meet- 
ing this goal were found. Bit error rate (BER) performance for the encoders was simulated, 
and this confirmed the effective free distance as a measure of unequal error protection. At the 
same time, the BER plots indicated that the number of code sequences with Hamming weights 
equal to the individual effective free distance is also an important measure of performance. 

Next, trellis coded modulation (TCM) systems with unequal error protection were inves- 
tigated. It was determined that providing unequal error protection with TCM coding is more 
difficult due to the limitations of the signal constellations. A limited number of trellis codes 
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were found, however, that provide a measure of unequal error protection. Further work on 
this subject is in progress. 
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THE UNEQUAL ERROR PROTECTION CAPABILITIES 
OF CONVOLUTIONAL AND TRELLIS CODES 
Abstract 


by 

Diane Grieselhuber Mills 

The research discussed in this dissertation studies the unequal error protection 
capabilities of convolutional and trellis codes. In certain environments, a discrepancy 
in the amount of error protection placed on different information bits is desirable. 
Examples of environments which have data of varying importance are a number of 
speech coding algorithms, packet switched networks, multi-user systems, embedded 
coding systems, and high definition television. Encoders which provide more than 
one level of error protection to information bits axe called unequal error protection 
(UEP) codes. 

In this work, the effective free distance vector, d, is defined as an alternative tp the 
free distance as a primary performance parameter for UEP convolutional and trellis 
encoders. For a given ( n,k ), convolutional encoder, G, the effective free distance 
vector is defined as the ^-dimensional vector d = • • • ,<4_ x ), where dj, the j th 

effective free distance, is the lowest Hamming weight among all code sequences that 
are generated by input sequences with at least one ”1 ” in the j th position. It is shown 
that, although the free distance for a code is unique to the code and independent of 
the encoder realization, the effective distance vector is dependent on the encoder 
realization. 

A modified transfer function, which provides a method to calculate d, is presented. 
The modified transfer function developes a new branch labelling rfiethod that allows 
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standard algorithms that were originally developed to calculate the free distance 
of a code to calculate the effective distance vector. 

Several upper bounds on d are derived and compared. The results of searches for 
good unequal error protection codes are presented. A primary goal of the searches 
was to find encoders with at least one effective distance greater than the free distance 
of the optimal code of the same rate and memory order. Bit error rate (BER) plots for 
the enocders are presented, confirming the effective distance as a measure of unequal 
error protection. At the same time, the BER plots show that the number of code 
sequences with Hamming weights equal to the individual effective distance is more 
important them expected. 

Trellis coded modulation (TCM) systems with unequal error protection are inves- 
tigated. It is determined that providing unequal error protection with TCM coding 
is difficult due to the limitations of the signal constellations. Topics for future inves- 
tigation are identified. 



TABLE OF CONTENTS 

LIST OF FIGURES v 

LIST OF TABLES viii 

ACKNOWLEDGEMENTS ix 

1 INTRODUCTION 1 

1.1 Introduction 1 

1.2 Digital Communications Systems 2 

1.3 Outline of Dissertation 4 

2 Error Control Coding 7 

2.1 Introduction 7 

2.2 Block Codes 8 

2.3 Convolutional Codes 11 

2.4 Unit Memory Codes 15 

2.5 Double Memory Codes 19 

2.6 Complexity Concerns 22 

2.7 Summary 23 

3 Unequal Error Protection Coding 24 

3.1 Introduction 24 

3.2 UEP Block Codes 25 


m 



IV 


3.3 Multi-level Coding 28 

3.4 Summary 29 

4 Unequal Error Protection with Convolutional Codes 30 

4.1 Introduction 30 

4.2 The Effective Free Distance Vector 31 

4.3 A Modified Transfer Function 34 

4.4 Two-Way Bounds 39 

4.5 k-Way Bounds • 44 

4.6 Plotkin-Type Bound 48 

4.7 Another bound 49 

4.8 Results 50 

4.9 Summary 78 

5 Achieving Unequal Error Protection with Trellis Coded Modulation 83 

5.1 Introduction 33 

5.2 Trellis Coded Modulation 84 

5.3 Unequal Error Protection with Trellis Coded Modulation 90 

5.4 Summary 95 

6 Conclusions and Recommendations for Future Research 96 



LIST OF FIGURES 


1.1 General communications system . . . . , 2 

2.1 General Block Code Encoder 8 

2.2 A General Convolutional Encoder 12 

2.3 A Specific (3, 2, 2) Convolutional encoder 14 

4.1 A specific (3, 2) encoder 33 

4.2 Trellis for a specific (3, 2) encoder 33 

4.3 Modified state diagram for a specific (3, 2) encoder with d = (3, 4) . . 37 

4.4 A specific (3, 2) encoder with d = (3, 3) 38 

4.5 Modified state diagram for a specific (3, 2) encoder with d = (3, 3) . . 38 

4.6 BER plot for R = 2/3, M = (1, 1) encoder with d = (3,4) 62 

4.7 BER plot for R = 2/3, M = (1,2) encoder with d = (4, 5) 62 

4.8 BER plot for R = 2/3, M = (1,2) encoder with d = (3, 5) 63 

4.9 BER plot for R = 2/3, M = (2,2) encoder with d = (5,5) 63 

4.10 BER plot for R = 2/3, M = (2,2) encoder with d = (4, 6) 64 

4.11 BER plot for R = 2/3, M = (1,3) encoder with d = (5,5) 64 

4.12 BER plot for R — 2/3, M = (1,4) encoder with d = (4, 9) 65 

4.13 BER plot for R = 2/3, M = (2,3) encoder with d = (6, 6) ...... 65 

4.14 BER plot for R = 2/3, M = (2,3) encoder with d = (5, 6) 66 


v 



vi 

4.15 BER plot for R = 2/3, M = (2,3) encoder with d = (4, 6) 66 

4.16 BER plot for R = 2/4, M = (1, 1) encoder with d = (5, 5) 67 

4.17 BER plot for R = 2/4, M = (1, 2) encoder with d = (6, 7) 67 

4.18 BER plot for R = 2/4, M = (1, 2) encoder with d = (5, 7) 68 

4.19 BER plot for R = 2/4, M = (1,2) encoder with d = (4,8) 68 

4.20 BER plot for R = 2/4, M = (2,2) encoder with d = (8, 8) 69 

4.21 BER plot for R = 2/4, M = (2,2) encoder with d = (7, 8) 70 

4.22 BER plot for R = 2/4, M = (1,3) encoder with d = (6, 8) 71 

4.23 BER plot for R = 2/4, M = (1,3) encoder with d = (5, 7) ' 71 

4.24 BER plot for R = 2/4, M = (1,3) encoder with d = (4, 9) 72 

4.25 BER plot for R = 2/4, M = (1, 3) encoder with d = (3, 10) 72 

4.26 BER plot for R = 2/4, M = (1,4) encoder with d = (7, 8) 73 

4.27 BER plot for R = 2/4, M = (1,4) encoder with d = (6, 10) 73 

4.28 BER plot for R = 2/4, M = (1,4) encoder with d = (5, 9) 74 

4.29 BER plot for R = 2/4, M = (1,4) encoder with d = (4, 10) 74 

4.30 BER plot for R = 2/4, M = (1,4) encoder with d = (3, 12) 75 

4.31 BER plot for R = 2/4, M = (2, 3) encoder with d = (8, 9) 76 

4.32 BER plot for R = 2/4, M = (2,3) encoder with d = (7, 8) 76 

4.33 BER plot for R = 2/4, M = (2, 3) encoder with d = (5, 9) ■ 77 

4.34 BER plot for optimal R = 2/3, M = (1, 1) encoder with d = (3) . . . 77 

4.35 BER plot for optimal R = 2/3, M = (1,2) encoder with d = (4) . . . 78 

4.36 BER plot for optimal R = 2/3, M = (2, 2) encoder with d = (5) . . . 79 

4.37 BER plot for optimal R = 2/3, M = (2,3) encoder with d = (6) ... 79 

4.38 BER plots for optimal R = 2/3, M = (3,3) encoder with d = (7) . . 80 

4.39 BER plots for optimal R = 1/2, M = (2) encoder with d = (5) . . . . 80 



Vll 


4.40 BER plots for optimal R = 1/2, M = (3) encoder with d = (6) . . . . 81 

4.41 BER plots for optimal R = 1/2, M = (4) encoder with d = (7) . . . . 81 

4.42 BER plots for optimal R= 1/2, M = (5) encoder with d.= (8) . . . . 82 

5.1 Amplitude Modulation Signal Sets 84 

5.2 Phase Shift Keying Signal Sets 85 

5.3 A General TCM System 86 

5.4 A Labeled 8PSK Signal Set 87 

5.5 Partitioning an 8PSK Signal Set 88 

5.6 A 4-State Binary Trellis 89 

5.7 A 4-State TCM Trellis 89 

5.8 A Labeled 16QAM Signal Set 91 

5.9 Alternative Labeling for an 8PSK Signal Set 93 

6.1 A Concatenated UEP System • 98 



LIST OF TABLES 


2.1 Optimal Unit Memory Codes 18 

2.2 Upper Bounds for Double Memory Codes 21 

2.3 Decoding Complexity Comparison , 23 

3.1 Selected UEP Block Code Results 28 

4.1 UEP bounds for Rate 2/3 Convolutional Encoders 50 

4.2 UEP bounds for Rate 2/4 Convolutional Encoders . 51 

4.3 UEP bounds for Rate 2/5 Convolutional Encoders 52 

4.4 UEP bounds for Rate 3/4 Convolutional Encoders 53 

4.5 Rate 2/3 UEP Convolutional Encoders 56 

4.6 Rate 2/4 UEP Convolutional Encoders 57 

4.7 Rate 2/5 UEP Convolutional Encoders 58 

4.8 Rate 3/4 UEP Convolutional Encoders 58 

4.9 Optimal convolutional encoders 59 

5.1 Unequal Error Protection with 8PSK TCM 94 

5.2 Unequal Error Protection with 16QAM TCM 95 



IX 


ACKNOWLEDGMENTS 


I would like to thank my advisor, Professor D.J. Costello, Jr., for his guidance 
and advice throughout this investigation. His expertise was very helpful and much 
appreciated. 

Dr. Peter Bauer, Dr. Robert L. Stevenson, and Dr. Mark A. Herro also deserve 
thanks for serving on my dissertation committee and commenting on my work. Dr. 
Reginaldo Palazzo and Lance Perez both deserve special thanks fpr the many hours 
of discussion and suggestions that they provided. 

I would like to thank the National Science Foundation, which provided three years 
of financial support with an Awaxd for Creativity in Engineering. 

Finally, I would like to thank my husband, Jim, and my sons, Robert, Andrew, 
and Daniel. I couldn’t have finished this work without their cooperation and support. 



CHAPTER 1 


INTRODUCTION 


1.1 Introduction 

The purpose of a communication system is to transmit information or data from 
one point to another. Using the sampling theorem, analog data may be digitized 
without loss of quality or information, allowing the use of digital communication 
systems. Digital communications systems typically perform better than analog com- 
munication system, for a number of reasons. For instance, digital processing reduces 
signal degradation, allows source coding to remove redundancies, thereby decreasing 
the transmission rate, and allows channel coding to decrease the error rate. Digital 
systems are generally more reliable and easier to maintain than analog systems. In 
addition, because digital systems rely more on software than hardware, it is often 
relatively easy to upgrade a digital system. 

As the volume of transmissions increases, bandwidth and energy- limited channels, 
introduce more errors. Transmission errors degrade the performance by reducing 
throughput, storage capacity, or reliability. Error control can be viewed two ways: 
for the same power and cost, the error rate may be decreased, or the error rate may 
be maintained, at a reduction in power and hardware costs. Channel coding, an error 
control technique, improves the reliability of digital data links and storage media. 
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Examples of systems in which coding is appropriate include computer storage sys- 
tems, communication networks, deep-space transmission systems, telephone channels, 
satellite channels, and optical storage system [32]. 

This chapter reviews basic communications concepts. Section 2 briefly describes 
a general digital communications system and discusses the issues that are usually 
important. Section 3 outlines the dissertation. 

1.2 Digital Communications Systems 


A model of a typical digital communication system is shown in Figure 1.1. 



Figure 1.1: General communications system 


The information source produces digital information which is to be transmitted to 
the destination. Using the information from the source, the source encoder generates 
a binary A:-bit message u £ , at each time instant t. It is not necessary that the the 
source encoder produces a binary output, but the assumption simplifies the discussion. 
Examples of sources include: a voice, a measuring instrument, and a computer. The 
information sequence, u, is a semi-infinite binary sequence. The channel encoder 
converts the information sequence into the code sequence, v, following some channel 
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coding rules. The goal of the channel encoder is to add enough redundancy so that 
the information may be reliably transmitted over the channel. The codewords are 
passed to the modulator, which generates continuous channel wave forms, s(f), called 
channel signals. The channel signals axe then transmitted over the channel to the 
receiver. The channel is any type of transmission medium, which may be, for example, 
a telephone line, satellite link, optical link, or magnetic storage media. Included in 
the channel model is a noise source, which is dependent on both the type of channel, 
and the specific channel used. The noise corrupts the original signal so that the 
continuous waveform at the output of the channel is r(t). The demodulator produces 
the received sequence, r. It is assumed that an optimum demodulator, such as a 
matched filter or correlation detector followed by a sampling switch and quantizer, 
is used. The channel decoder applies a decoding rule to the binary sequence r and 
produces an estimate, v, of the transmitted code sequence v, and, consequently, an 
estimate, u, of the message u. 

An optimum decoding rule must minimize the probability of a decoding error, 
P(£). The conditional probability of decoding error, given that r is received is defined 
as P(£|r) = P(v ^ v). It is easily seen that P(£) = P(£ |r)P(r). Since P( r) 

is independent of the decoding rule, the decoder will to minimize the probability of 
error by minimizing P(£ |r) for all r, or equivalently, maximizing P(v = v | r) for all 
r. Therefore, an optimum decoder must, for a given received sequence r, decide which 
is the most likely code sequence, v. That is, the decoder must choose the codeword 
estimate v as the codeword v which maximizes 


P(v | r) = 


p(p 1 y ) pm 

P(r) 


( 1 . 1 ) 


If all codewords are equally likely, then maximizing P(v | r) is equivalent to maximiz- 
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ing P(r| v). Furthermore, if the channel is a discrete memoryless channel (DMC), 
P( r | v) = n, P( r i I *>,•), where v = (. . . v ;_i u f - v,+i . . .) and r = (. . . r,_i r,- r l+1 . . .). 
Therefore, minimizing the probability of decoding error is equivalent to maximizing 
log P( r i I v i)- A decoder which maximizes P(r | v) is called a maximum likelihood 
decoder. 

The source decoder then uses u to generate an estimate of the original source 
information. This dissertation focuses on the channel coding operation, and the 
modulation operation. For that reason, the source coding/decoding is ignored. The 
primary design criterion considered in this dissertation is error probability. Other 
factors with affect the cost and performance of the overall communication system 
include throughput and implementation complexity. 

There are three common types of error probabilities used to measure the perfor- 
mance of a channel coding system. The bit error probability, Pb{£), is the expected 
number of information bit decoding error per decoding information bit. The symbol 
error probability, P a (£), is the probability that a channel signal or symbol is decoded 
incorrectly, and the first event error probability, Pj{£), is the probability that a chan- 
nel signal or symbol is decodes incorrectly for the first time after a specific signaling 
interval. The bit error probability is the best measure of the probability that the 
information transmitted is properly received, but symbol error probability or the first 
error event probability are often easier to calculate for specific systems. Primarily, 
bit error probabilities are examined in this work. 

1.3 Outline of Dissertation 

In certain environments, a discrepancy in the amount of error protection placed 
on different information bits is desirable. For example, the sign bit and high order bits 
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of pulse coded modulation (PCM) data axe more critical to system performance than 
the lower order bits [57], In packet switched networks, the header information requires 
more error protection than the data;, and in multi-user environments, different users 
may require more error protection than others. In Adaptive Predictive Coding and 
Code-book Excited Linear Prediction, the filter coefficients and the codebook choice 
axe more important than the residual information. Systems in which some information 
is non-essential enhancement information, e.g. embedded coding schemes and high 
definition television, are also potential application environments [6] [68]. Encoders 
which provide more than one level of error protection to information information 
bits axe called linear unequal error protection (LIJEP) codes. It is also possible to 
provide unequal error protection the channel bits, but that is not discussed in this 
work. The purpose of unequal error protection is to provide a higher degree of error 
protection for the more important bits, without increasing the associated increase in 
complexity /cost /bandwidth that would occur if the protection were increased for the 
entire information stream. The research discussed in this work studies the unequal 
error protection capabilities of convolutional codes. 

The dissertation is organized as follows. Chapter 2 discusses error control coding, 
particularly block codes and convolutional codes. In addition to general convolutional 
codes, two specific types of convolutional codes, unit memory codes and double mem- 
ory codes are presented. Some basic concepts that are used later in the dissertation 
are introduced. Chapter 3 discusses previous work on unequal error protection codes. 
Unequal error protection block codes and multi-level codes axe briefly reviewed. Next, 
new work on the unequal error protection capabilities of convolutional codes is pre- 
sented in Chapter 4. The effective free distance vector is defines as a performance 
parameter. A modified transfer function which allows analysis of unequal error pro- 
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tection convolutional codes is presented. Upper bounds on the effective free distances 
are derived. Also, results of code searches are presented and bit error rate simulations 
for specific encoders axe discussed. Chapter 5 presents extensions of the results in 
Chapter 4 to trellis coded modulation. Chapter 6 contains conclusions and sugges- 
tions for further research. 



CHAPTER 2 

Error Control Coding 


2.1 Introduction 


The purpose of an error control code is to increase the probability that a message 
will be reliably transmitted over a noisy channel. This chapter begins by reviewing 
two common classes of error control codes: block codes and convolutional codes. Both 
types operate on bit streams emitted from information sources. It is assumed that 
the information stream is binary, i.e. consists only of 0’s and l’s, but results may be 
generalized to an arbitrary alphabet. Block codes are discussed in Section 2.2. The 
distinction between a code and an encoder is made, and the minimum distance of a 
code is discussed. Section 2.3 describes convolutional codes. The section includes a 
general description of convolutional codes, as well as several examples. In addition, 
the minimum free distance of a convolutional code is defines. Section 2.4 describes 
Unit Memory Codes, a special class of convolutional codes. Another special class of 
convolutional codes, Double Memory Codes, axe discussed in Section 2.5. 
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2.2 Bio 


ck Codes 


A block encoder divides the message sequence into message blocks of Ar-bits, u, 
and transmits associated codewords, v, of length n. Figure 2.1 shows a general block 
codes. There is a one-to-one correspondence between each possible message block 
and its associated codeword. Because each message block consists of k bits, there 
are 2 k codewords. The (n, k ) binary block code is the set of 2 k n-dimensional binary 
codewords. Each codeword depends only on the current input, so the system is 
memoryless. The rate of the code is defined as R = k/n. For block codes, the rate 
is generally expressed as a proper fraction. That is, a code with k = 2 and n = 4 is 
called a rate 1/2 code. 


- 


n 


1 


■ 

■ 

■ 

kJ 



.0 

.1 

2 


ji-1 


Figure 2.1: General Block Code Encoder 


A distinction between a code and an encoder is made. An encoder is the rule 
that maps each possible k - bit input to a specific n-bit codeword. That is, an encoder 
divides an information sequence into blocks of length k , between each A:-bit message 
block and n-bit codeword. An encoder realization of a specific code is not necessarily, 
and in fact is not normally, unique. For instance, consider the rate 1/2 code, C = 
{0000, 1010,0101, 1111}. The code is the set of four codewords listed. One possible 
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encoder realization of the code makes the following associations between the input 
messages and the codewords. 


u — ► v 

00 0000 

01 0101 (2.1) 

10 1010 

ii mi 

Another possible encoder makes the following different associations between the input 
messages and the codewords. 


u — ► v 

00 0000 

01 1010 ( 2 . 2 ) 

10 mi 

11 0101 

Although the encoders generate the same code, or set of n-tuples, the associations 
between input and outputs differ. 

An encoder can be represented by a generator matrix G, which spans the space 
of the codewords and shows the relationships between the message words and the 
codewords with the equation 


v = u • G 


(2.3) 


The first encoder example, given in ( 2.1) has the generator matrix 


G = 


10 10 

0 10 1 ’ 


(2.4) 


while the encoder in ( 2.2 ) has the generator matrix 


1111 
10 10‘ 


G = 


(2.5) 
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The two encoders, and their corresponding generator matrices, axe different realiza- 
tions of the same code. To rephrase, a code is the set of n-dimensional vectors, while 
an encoder can be thought of as a set of ordered pairs of fc-bit information blocks and 
n-bit codewords. 

A useful performance parameter of a linear binary block code is the minimum 
distance, d m ;„, between any two codewords. The Hamming distance between two 
codewords v and v', df{(v, v') is the number of corresponding bits of v and v' that 
are different. The minimum distance of a code C is then defined as the minimum 
Hamming distance between any two codewords, i.e. 

d min = min[d ff (v, v') : v,v' € C). (2.6) 

For linear block codes, an equivalent definition of d mm is the minimum Hamming 
weight of any codeword, where the Hamming weight of a codeword v is the total 
number of l’s in v, and is denoted by wh(v). 

Maximum likelihood decoding of binary block codes chooses the codeword that 
differs in the fewest number of bit positions from the received n-tuple, r. That is, a 
maximum likelihood decoder chooses the codeword that is “closest” to the received 
n-tuple. When maximum likelihood decoding is used, a code with minimum distance 
dmin is guaranteed to detect (d mtn — 1) bit errors introduced by the transmission 
channel. The error detection capability stems from the fact that corruption of (d mtn — 
1) or fewer bits of the transmitted codeword will results in an n-tuple that does not 
belong to the set of codewords. In that case, it is apparent to the receiver that the 
received n-tuple is corrupted. However, if d mtn or more bits are changed, it is possible 
that the received n-tuple is itself a codeword, but not the codeword that was sent. 
The decoder has no way to tell that this is the case. Similarly, a code with minimum 
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distance d min is guaranteed to correct [(cL.n - l)/2j transmission errors, because an 
error pattern of (d min — 1) or fewer errors will not move the received n-tuple to a 
point closer to a codeword different from the transmitted codeword. 

2.3 Convolutional Codes 

Elias [12] proposed convolutional codes as an alternative to block codes. Like block 
codes, convolutional codes separate the information sequence into k - bit message 
blocks and n-bit codewords. However, with convolutional codes, encoder output 
depends on both the current and previous message blocks. The fc-bit message blocks 
can be viewed in (at least) two ways: a sequence of k consecutive bits that originated 
as a sequence from one information source, or one bit from each of k information 
sources. Either model is appropriate, although one or the other is sometimes more 
conducive to better understanding for specific applications. The distinction between 
code and encoder that was made in Section 2.2 is applicable to convolutional codes. 

A general convolutional encoder is shown in Figure 2.2. The fc-bit block entering 
the encoder at time t \ s u t , and the n-bit codeword leaving a convolutional encoder at 
time t is v t . Let be the entire message sequence entering the encoder from times 
t 0 to t u i.e. u Wl = (u i0 u, 0+1 , . . . u tl ). Similarly, v Wl = (v to v to+ i . . . v tl ) denotes the 
entire code sequence leaving the encoder during times to to t\. An (n, k, m) binary 
convolutional code can be represented by the encoding equation 

v t = u t G 0 + Uf_iG| + ... + u*_ m G m , (2*7) 

where the encoding matrices, Gj, i = 0, 1, axe ( k x n) binary matrices. The 

memory distribution vector M = (^ 0 ,^ 2 ,...,^-!) indicates the size of the shift 
register on each input line. For example, the first input line has mo memory units. 
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The maximum number of memory units on any one line is m. The state complexity, or 
memory order, of a convolutional code is defined to be the number of state variables, 
K = £>,. 

An alternative equation description of a convolutional encoder is 

v = u • G, (2.8) 

where u = (uoUx . . .) is the semi-infinite sequence of message blocks, v = (v 0 Vx . . .) is 
the semi-infinite sequence of codewords, and G is the semi-infinite generator matrix 
formed from the encoder matrices 

(2.9) 

Figure 2.3 shows a (3,2,2) convolutional encoder with M = (1,2), K = 3, and 
encoding matrices 


G = 


Go Gi • - ■ G m 
0 Gq Gi 


G m 0 


Go = 


0 1 0 
1 1 1 


Gx 


0 0 1 
0 1 1 


G2 


0 0 0 
1 1 0 


( 2 . 10 ) 


The free distance, d/ ree , of a convolutional code, C, is the minimum Hamming 
distance between all pairs of code sequences. Formally, 

dfree — min [dtf(v 0it ,Vo )t ) : andv 0>t ,Vo it € C). (2.11) 

v 0l t* v o, f 

Due to the linearity of binary convolutional codes, the free distance is also the mini- 
mum Hamming weight of any non- zero code sequence, 

dfret = min[t£>//(v 0 ,t / 0 : v 0 , t € C)). (2.12) 

It is assumed that the first non- zero input to the encoder arrives at time 0. The 
free distance can be difficult to determine because code sequences may be of infinite 
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Figure 2.3: A Specific (3, 2, 2) Convolutional encoder 


length. Often, bounds are calculated for the maximum achievable free distance (upper 
bounds) [9, 30, 19, 17] so that the performance of a particular code can be compared 
to the best theoretical performance. 

Convolutional encoders are occasionally described by a transfer function. The 
concept of the transfer function of a convolutional encoder is used later in the dis- 
sertation, and is reviewed here. It is assumed that the reader is familiar with the 
method of determining a transfer function from an augmented state diagram using 
Mason’s gain formula [32], or some other algorithm [66], [54], and [8]. 

The two- variable transfer function has the form 

t(x, y) = g; (2.i3) 

d=dfree &=1 

where Ab,d is the number of code sequences with Hamming weight d that have cor- 
responding (input) message blocks with Hamming weight b. The average bit error 
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probability for a specific transfer function is bounded by 

P b (E)<l.J2B d .P d , (2.14) 

K d 

where Bj = b.Abj is the total number of non-zero information bits associated with 
all codewords of weight d, and Pd = (y^4p(l — p)j . For the sake of simplicity, we 
have assumed a binary symmetric channel with crossover probability, p. 

Examining the above equation, it is seen that the dominating term in the upper 
bound on the bit error probability is the term with the lowest value of d, which 
happens to be the free distance. This explains the use of the free distance as a 
performance measure for convolutional codes. 

Typically, the Viterbi algorithm [32], [67], [38], [14], [15] is used to decode convo- 
lutional codes with relatively small memory orders. Viterbi decoding is a maximum 
likelihood decoding algorithm, i.e. it selects the code word that minimized the prob- 
ability of decoding error, assuming all codewords are equally likely. The complexity 
of the Viterbi algorithm increases dramatically as the number of states in the trellis 
increase. For that reason, sequential decoding, [69] [13] [73] [22], is generally used for 
encoders with K > 10. 

2.4 Unit Memory Codes 

An interesting class of binary convolutional codes are unit memory codes [31] [29] 
[25]. A unit memory code (UMC) is a binary convolutional code with memory m = 1 
and multiple input lines, i.e. k > 1. Therefore, the encoding equation of a UMC 
is v f = u t Go + Ut_iGi. An (n 0 ,fc 0 ,m) convolutional code with ( k 0 x n 0 ) encoding 
matrices go, gi, • • • , g m , is equivalent to the (n = mn 0 , k = mk 0 , 1) UMC which has 
the two ( mk 0 x mn 0 ) binary encoding matrices 
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G 0 = 

' go 
0 

gi 

go 

* * ’ gm— 1 

gm— 2 

Gi = 

gm 

gm-l 

0 

gm 

... o ’ 
0 

• • 


. 0 


go . 


. gl 

• . . 

gm „ 


(2.15) 


The two encoders axe equivalent in the sense that they generate identical outputs 
when operating on identical input sequences. This is easily verified by compaxing 
the semi-infinite generator matrices of the two encoders. For the basic encoder^ the 
semi-infinite generator matrix is 


G& a4 ,' c — 


go gl 
0 go gl 

0 0 


gm-l 0 
■ • ■ gm-l 0 


(2.16) 


where each entry is a (k 0 x n 0 ) sub-matrix. On the other hand, the semi-infinite 
generator matrix for the unit memory code is 






1 

0 

o 

0 

o 








Gumc = 

0 Go Gi 

0 

7 


(2.17) 





1 

o 

o 





with ( mk 0 

x mn 0 ) 

sub-matrices. Replacing Go 

and G x with the expressions from 

2.15, 

go 

gi 

gm— 1 

gm 0 

• 0 

• 




0 

go 

gm— 2 

gm— 1 gm 

0 

■ * 

0 




0 


go 

gl 

gm 




Gumc = 




go gl 

gm— 1 gm 0 

0 





0 

0 go 
• • 

gm— 2 gm— 1 gm 

W 9 • 

0 

0 





0 ... 

go gl 

gm 





0 

0 


* * 


■ . 


(2.18) 

Comparing Equations (2.16) and (2.18) confirms Equation (2.15. 

As an example, consider the (2,1,3) basic convolutional encoder with encoder 
matrices g 0 = [1 1] , gi = [1 1] , g 2 = [0 1] , and g 3 = [1 1]. When the input to 
the encoder is the message sequence (101110010 ■ • •), the code sequence is 
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(11 11 10 11 01 01 10 00 11 • * *)- The associated (6,3,1) unit memory encoder has 
encoding matrices 

' 11 11 01 ] [ 11 00 00 ' 

G 0 = 00 11 11 and Gi = 01 11 00 (2.19) 

00 00 11 J [ 11 01 11 . 

When the input to the unit memory encoder is the message sequence (101 110 010 • • •), 
the code sequence is (111110 110101 100011 • • •). 

Let n„ and k 0 be relatively prime. The class of (n 0 , k a , m) convolutional codes 
will hereafter be called basic convolutional codes. The encoding matrices of a UMC 
that has been converted from a basic code must adhere to the form in Equation 2.15. 
However, the encoder matrices for a general UMC are not under the same restric- 
tion. That is, general UMC matrices are not block triangular matrices with constant 
diagonals. It follows that UMCs axe a larger class of codes than basic convolutional 
codes. In addition, since every basic convolutional code can be converted to a UMC 
of the same rate and state complexity, the optimal UMC has a free distance at least 
as large as the free distance of the optimal basic code. 

Lee developed an upper bound on the free distance of a (n, k , 1) UMC, which 
is now presented. As previously stated, the free distance, dj Tee , of a convolutional 
code is the minimum Hamming distance between all pairs of code sequences that are 
associated with input sequences that differ in at least one message block. It can be 
assumed without loss of generality that one of the code sequences in the comparison 
is always the all-zero sequence, and that the first non-zero portion of the other code 
sequence in the comparison occurs at time 0. So, the free distance is the minimum 
Hamming weight among all code sequences generated by input sequences that are 
non-zero in the message block at time 0, i.e. 

dfree = min [u>//(v 0 ,t) for all t]. (2.20) 

Uo#0 
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When the only non-zero portion of the information sequence is u 0 , then the only non- 
zero output is occurs at times 0 and 1, and is vo,i = u 0 [G 0 Gi]. The set of all such u 0 ’s 
and v 0 ,i’s forms a (2 n, k) block code. Therefore, at least one code sequence belonging 
to the UMC has a Hamming weight less than or equal to the minimum distance of the 
optimal (2n, k) block code. The minimum distance of the optimal (2n, k ) block code 
will be denoted d op t(2n, k). It follows that the optimal free distance of the (n, k, 1) 
UMC is upperbounded by d opt (2n, k). The optimal block code minimum distances axe 
tabulated in [18, 65]. In several cases, the UMC upper bound is laxger than the free 
distance attained by the optimal basic codes of the same rate and state complexity. 
Lee conducted an exhaustive search for the optimal UMCs and found several UMCs 
with a larger free distance than the optimal basic codes of the same rate and state 
complexity. Lee’s results are shown in Table 2.4. 


(n,k) 

UMC 

upper 

bound 

optimal 

UMC 

optimal 

basic 

(4.2) 

5 

5 

5 

(6,3) 

6 

6 

6 

(8,4) 

8 

8 

7 

IGEl 

9 

9 

8 

KEB1 

10 

10 

10 

(6,2) 

8 

8 

8 

(9,3) 

10 


10 

(12,4) 

12 


12 

(15,5) 


15 

13 

KUsfi)J 

16 

16 

15 

(8,2) 

10 

10 

10 

(12,3) 

13 

13 

13 

(16,4) 

16 

16 j 

16 

(20,5) 

20 

20 

18 

(24,6) 

24 

24 

20 


Table 2.1: Optimal Unit Memory Codes 


A drawback associated with UMCs is a possible increase in Viterbi decoding com- 
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plexity when compared to the complexity of basic convolutional codes. The increase 
in complexity is a result of the increased number of branches leaving each state of 
a trellis representation of the encoder. The number of branches leaving each state 
is called the branch complexity. A (n 0 ,fc 0 ,m) basic convolutional code has a branch 
complexity of 2 fco , while a ( mn 0 , mk 0 , 1) UMC has a branch complexity of 2 mk °. There- 
fore, the cost of a (potential) increase in the free distance is an increase in the branch 
complexity. The state complexities of the (n 0 ,k 0 ,m) basic convolutional code and 
(mn 0 ,mk 0 , 1) UMC are both 2 mko . While state complexity is the primary measure of 
Viterbi decoding complexity, the branch complexity effects are not negligible. How- 
ever, the branch complexity per decoded information bit of the basic encoder and 
UMC are identical. - 

The results obtained by Lee for UMCs led to the study of Double Memory Codes 
[35], which are discussed in the next section. 

2.5 Double Memory Codes 

This section describes double memory convolutional codes and presents an upper 
bound on their free distance [35]. It is shown that the free distance upper bound 
can be larger than the free distances previously attained by codes with relatively 
prime k and n. For certain rates, the bound is as large as the upper bound for unit 
memory codes. A double memory code which has a free distance larger than the free 
distance of the optimal basic code is briefly described. Double memory codes have 
lower branch complexities then the corresponding unit memory codes. 

A double memory code (DMC) is a convolutional code with m = 2 that can be 
described by v t = u t G 0 + Ut.jGi + u t _ 2 G 2 . It is assumed unless explicitly stated 
otherwise that the memory allotted to every input line is 2. It can be seen that 
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any (n 0 , k 0 , 2m) convolutional code with ( k Q x n 0 ) encoding matrices g 0 , gi, g 2 m is 
equivalent to the ( mn 0 , mk 0 , 2) DMC with ( mk 0 x mn„ ) encoding matrices 



' go 

gi ••• 

gm-1 


gm 

gm+l 

' ' ’ g2m-l 

Go — 

0 

go 

gm— 2 

G x = 

gm— 1 

gm 

g2m-2 

■ 9 

■ • 


. 0 


go . 


. gl 

g2 

gm . 


g2m 0 ••• O' 

g2m-l g2m 0 

• ■ « 

« » « 

. 8m+l ' - ’ g2m . 


( 2 . 21 ) 


It should be noted that the class of double memory codes, although smaller than 
the class of UMCs, is larger than the class of basic convolutional codes. This results 
from the fact that every basic code can be converted to an equivalent DMC, and every 
DMC can be converted to an equivalent UMC, but the reverse relationships (UMC 
to DMC, and DMC to basic code) do not hold for all UMCs or DMCs. 

An upper bound on the free distance may be developed in the same way that 
the bound for UMCs was developed. The free distance is again recognized as the 
minimum weight vector resulting from an information sequence that is non-zero at 
time 0. For an (n, k, 2) DMC, the set of such Uo’s and their associated outputs can be 
considered as a (3 n, k ) block code with Vo ,2 = Uo[G 0 GiG 2 ]. Accordingly, the optimal 
dj r ee is upper bounded by the highest attainable minimum distance of a (3n, k ) block 
code. 

The free distance bounds for k > 1 are shown in Table 2.5. As for UMCs, the free 
distance of the optimal basic code with the appropriate rate and state complexity 
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(n,k) 

K 

DMC 

upper 

bound 

UMC 

upper 

bound 

optimal 

UMC 

optimal 

basic 

(4,2) 

4 

8 

8 

8 

7 

(6,3) 

6 

10 

10 

10 

10 

(8,4) 

8 

12 

14 


12 

(10,5) 

10 

15 

16 


14 

(6,2) 

4 

12 

12 

12 

12 

(9,3) 

6 

15 

16 

16 

15 

(12,4) 

8 

18 

22 

22 

18 

(15,5) 

10 

22 

27 


22 

(18,6) 

12 

26 

32 


24 


Table 2.2: Upper Bounds for Double Memory Codes 


provides a lower bound on the optimal DMC free distance. The table lists the k and 
n used for the DMC. The DMC at a given rate is compared to the optimal ( n 0 ,k 0 ) 
basic convolutional code with the same memory order, K, and the optimal (2n,2Ar) 
UMC with the same rnemory order. In some cases, the block code upper bound for 
the DMC free distance is larger than the free distance achieved by the optimal basic 
code of the same rate and state complexity. In particular, consider the rate 2/4, 5/10, 
and 6/18 bounds. However, the existence of a DMC that attains the block code upper 
bound is not guaranteed. A rate 2/4 DMC encoder with free distance 8 was found. 
The encoding matrices for that encoder axe: 


Go 


1110 

0 10 1 ’ 


G a 


10 0 1 
1111 


and G 2 


1110 
0 10 1 


( 2 . 22 ) 


Double memory codes are interesting for several reasons. First, the free distance 
performance of a DMC is at least as high as the free distance of the basic code of 
the same rate and state complexity, in some cases, the upper bound for DMCs are 
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equal to the upper bound for the UMC of the same states complexity. In addition, 
as with UMCs, the form of DMCs is byte-oriented, which is attractive for use in 
concatenated coding systems. Finally, partial double memory codes, in which fewer 
than two memory units are allocated to a portion of the input lines, show potential as 
unequal error protection codes, due to the unbalanced distribution of memory units. 

2.6 Complexity Concerns 

In general, when decoding a (n, k, m) convolutional code with state complexity 
K , a Viterbi decoder must have a 2 n x 2 n lookup table, and performs 2 K • 2 k additions 
and 2 k • ( 2 k — 1) binary comparisons to decode k information bits. The Viterbi 
decoding complexities of a (mn 0 ,m& 0 , 1) UMC, (yn 0 , yfc 0 ,2) DMC, and ( n o ,k 0 ,m ) 
basic convolutional codes are compared in this section. In the example that follows, 
n 0 = 2, k Q = 1, and m = 4. The free distance for the optimal (2,1,4) convolutional 
code is 7, while the free distance of the optimal (8,4,1) UMC and the (4,2,2) DMC 
is 8. 

To decode 4 information bits, the Viterbi decoding for the UMC requires a 256 x 
256 lookup table, and performs 16-16 = 256 additions and 16-15 = 240 comparisons. 
On the other hand, the Viterbi decoder for the DMC requires a 16 x 16 lookup table, 
and 16 • 4 = 64 additions and 16 • 3 = 48 comparisons to decode 2 information bits. 
Finally, to decode 1 information bit, the Viterbi decoding for the basic convolutional 
code performs 16 • 2 = 32 additions and 16 • 1 = 16 comparisons, and uses a 4 x 4 
lookup table. 

The requirements per decoded information bit for the three codes are shown in 
Table 2.6. The complexity of the basic convolutional code is obviously the smallest, 
while the complexity of the UMC is the largest. For this example, the DMC provides 
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a larger free distance than the basic code, with a reduced decoding complexity when 
compared to the UMC. In general, the tradeoffs of performance vs. complexity are 
dependent on the specific codes of interest. 


UMC 

DMC 

basic 

lookup table: 256 x 256 

16 x 16 

4x4 

additions: 64 

32 

32 

comparisons: 60 

24 

16 


Table 2.3: Decoding Complexity Comparison 

2.7 Summary 

The increase in free distance exhibited by Unit Memory Codes when compared 
to the appropriate basic code led to the hope that, rather than increasing the. free 
distance and error protection encountered by all information bits, the error protection 
for one input bit position could be significantly increased. That is, the additional 
capabilities of the unit memory code could be focus on a specific information bit 
position. The next chapter introduces unequal error protection coding, and reviews 
previous work done in the area. The subsequent chapter then discusses unequal error 
protection with convolutional codes. 



CHAPTER 3 


Unequal Error Protection Coding 

3.1 Introduction 

In certain environments, a discrepancy in the amount of error protection placed 
on different information bits is desirable. For example, the sign bit and high order 
bits of pulse coded modulation (PCM) data are more critical to system performance 
than the lower order bits [57]. In packet switched networks, the header information 
requires more error protection than the data, and in multi-user environments, different 
users may require more error protection than others. In Adaptive Predictive Coding 
and Code-book Excited Linear Prediction, the filter coefficients and the codebook 
choice are more important than the residual information. Systems in which some 
information is non-essential enhancement information, e.g. embedded coding schemes 
and high definition television, are also potential application environments. Encoders 
which provide more than one level of error protection to information information 
bits axe called linear unequal error protection (UEP) codes. It is also possible to 
provide unequal error protection the channel bits, but that is not discussed in this 
work. The purpose of unequal error protection is to provide a higher degree of error 
protection for the more important bits, without increasing the associated increase in 
complexity /cost /bandwidth that would occur if the protection were increased for the 
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entire information stream. 

This chapter briefly reviews unequal error protection approaches that have been 
published in the past. The bulk of unequal error protection (UEP) codes have been 
block codes. The general concepts of UEP block codes axe presented in Section 3.2 
Multi-level coding with unequal error protection is discussed in Section 3.3. 

3.2 UEP Block Codes 

Wolf and Manisck introduced unequal error protection block codes [34]. Since 
then new results have been presented for classes of codes that include nonsystematic 
cyclic UEP codes, codes derived form difference set, iterative and concatenated de- 
signs of UEP codes, cyclic code classes, and linear a UEP codes derived form shorter 
codes [33] [51] [63] [11] [64]. 

An important concept in evaluating UEP block codes is the separation vector, 
first defined in [11]. For a linear (n, k ) binary code C , the separation vector s(G) = 
[si(G), . . . , ^^(G)] with respect to encoder matrix G of C, is defined as 

s,(G) = minu>//(uG) for all u such that Ui ^ 0, (3-1) 

where u t is the i th bit of the fc-bit message u. The definition of the separation vector 
immediately leads to the following result. For a linear (n, k ) code with encoding 
matrix G , complete maximum likelihood decoding guarantees correct decoding of the 
i th information bit whenever the error pattern has a Hamming weight less than or 
equal to [(si(G) — l)/2j . If a linear code C has an encoding matrix G with a separation 
vector for which components are not mutually equal, then the code is called a linear 
unequal error protection code. It is possible to order the separation vector so that 
the components are non-increasing, simply by reordering the rows of G. Every code 
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has an optimal generator matrix G“, whose separation vector is componentwise larger 
than or equal to the separation vector of any other generator matrix of the code The 
separation vector of a linear code is defined as the separation vector of the optimal 
generator matrix of the code. 

It is easily seen that the minimum distance of the code is equal to the smallest 
component of the separation vector, i.e. d m i n = min,- [s,-]. It should be noted that the 
separation vector is a measure associated with a particular encoder realization of a 
code 

Van Gils [63] [64] defined the minimal length necessary to achieve a specific sepa- 
ration vector for a given rate as a basic parameter of UEP block codes. He developed 
several bounds on that parameter. He first defined n(s) as the length of the shortest 
linear binary block code dimension k with a separation vector of at least s. 

An (n(s),fc,s] code is called optimal if an (n(s),A:,t] code with t > s, t ^ s, 
does not exist. The inequality between the two vectors indicates a componentwise 
comparison. For example, if s = (2,3,4), t = (3,3,4), and w = (2,5,5), then t > s, 
and w > s. The relationship between w and t is best described by the equations 
w ^ t, w ^ t, and w ^ t. 

An upper bound on n(s) is 

n ( s ) ^ ( 3 - 2 ) 

1=1 

The proof of 3.2 is straightforward. For l = 1, • • • , k, let Gj be the (1 x s/) matrix 
[1,1, *••,!.]. Then, each matrix G/ has minimum distance sj. Let G be defined 
as the (k x n(s) matrix G = diag[G 1 G 2 • • • G*]. Then G has separation vector 
s = (si, s 2 , ■ ■ ■ , sjt), and n( s) < £i=i s^. 

An interesting lower bound on n(s) discussed in [63] is 
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"(s) > Ufa/ 2 * 'I, (3-3) 

t'=i 

where the components of s are ordered so that they are nonincreasing. 

The proof of 3.3 follows. Let C be a linear (n = n(s),fc,s) binary code, and let 
G be a minimal weight generator matrix for C. It can be shown that the first row 
of G, denoted by ri, has Hamming weight s\. Without loss of generality, the first 
columns of G have a 1 in the first row. Deleting the first Sj columns and the first 
row of G yields a (k — 1) x (n — Si) binary matrix, G, with rank k — 1. Hence, G is 
a generator matrix of an (n — si, k — 1) code with separation vector, s = (s* 2 , ■ • • , s*). 
Let j € {2, • • ■ , fc}, and let u be the message block that is non-zero only in the j th 
bit position. Then c = uG = (ci|c 2 ), where ci has length si and wh{ C 2 ) = Sj. By 
definition of the separation vector, 

wh( ci) + Sj > sj. (3.4) 

Furthermore, at least wh(c\) components of ci equal 1, so 

(row (i) - c) < si - w H {ci ) + Sj. (3.5) 

However, 

u;tf(row(i) — c) > max(si,Sj), - (3.6) 

so 

n(s)(si,---,s fc ) > +n(fy],---, fyl). (3.7) 

Repeating the process results in the bound given in 3.3. 

Table 3.2 presents some of the separation vectors that were shown in [63]. The 
optimal minimum distance for each rate (n,k) is shown in the column labeled d opt , 
and the achieved separation vectors are shown in the column labeled s. 
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n 

k 

d Q pt 

s 

4 

2 

2 

(3.2) 

5 

2 

3 

(4,2) 

5 

3 

3 

(3,2,2) 

6 

2 

4 

(5,2) 

6 

3 

3 

(4,2,2) 

8 

2 

5 

(7,2), (6,4) 

8 

3 

4 

(6,2,2), (5,4,4) 

8 

4 

4 

(5, 2, 2, 2) 


Table 3.1: Selected UEP Block Code Results 

In addition to, or, in some cases, is lieu of the separation vector, several authors 
use a mean distortion vector as a measure of LUEP block code performance [51]. The 
design criterion is the overall mean square error between the numerical representations 
of the decoded k-bit sequence and the original fc-bit information sequence . However, 
mean square error is dependent on the method of numerical representation, and not 
as closely related to the bit error rate. The method is useful for specific applications 
but is not used in this dissertation. 

3.3 Multi-level Coding 

Multi-level coding is another method used to achieve UEP [28, 50, 6]. The informa- 
tion sequences that require more error protection are assigned to the more powerful 
subcoders in the multi-level coding system. Multi-level codes have the disadvantage 
of high decoder complexity. The advantage of the method lies in the ease of achieving 
large disparity in the protection provided. 

The first technique proposed in [6] is a time sharing generalization in which the 
code specifies the multiplexing rule that is to be chosen. That is, two different code sig- 
nal constellations are possible, and the choice of the constellation is dependent on the 
importance of the data. The second UEP technique proposed in that paper combined 
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multi-level coding and non-standard set paxtitioning. In a nonstandard partitions, 
less important data may be assigned to the points within a subset, thereby allowing 
the minimum intr-subset distance to be smaller than the standard set partitioning. 
The important data may then have an increased minimum Euclidean distance. 

3.4 Summary 

In this chapter, unequal error protection coding was introduced. In particular, 
binary linear UEP block codes were discussed. The separation vector was defined, 
and some bounds on the necessary code length for a given separation vector were 
presented. The next chapter discusses unequal error protection with convolutional 


codes. 



CHAPTER 4 


Unequal Error Protection with 
Convolutional Codes 

4.1 Introduction 

In this chapter, we examine the unequal error protection capabilities of convo- 
lutional codes by presenting classes of convolutional codes which satisfy the basic 
property of LUEP codes, that is, provide unequal error protection for each input in- 
formation digit. The LUEP property is satisfied for certain rates R = fc/n, where 
k > 2 and k and n are not necessarily relatively prime. 

In contrast with the UEP block codes discussed in Chapter 3, the LUEP convolu- 
tional codes presented in this dissertation lack algebraic structure. For that reason, 
good codes are found by a search procedure. Optimal decoding for UEP convolu- 
tional codes remains the Viterbi decoding for short-constraint-length, or sequential 
decoding for long constraint-length. 

This chapter is organized as follows. In Section 4.2, the effective free distance vec- 
tor is presented. Section 4.3 presents a modified transfer function for convolutional 
encoders from which the unequal error protection capabilities of a code can be cal- 
culated. Several bounds on the unequal error protection capabilities of convolutional 
encoders are derived and discussed in Section 4.4. Finally, Section 4.5 presents the 
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results of searches for UEP codes. 

4.2 The Effective Free Distance Vector 

It is convenient to define an effective free distance vector, d, as an alternative 
to the free distance as a primary performance parameter for UEP convolutional en- 
coders. The effective free distance vector is similar to the separation vector concept 
of linear UEP block codes discussed in the previous chapter. Similar vectors have 
been proposed in [43], [40], [36], [37], [35], [49]. 

For a given (n,fc), k ^ 1 convolutional encoder, G, the effective free distance 
vector is defined as the ^-dimensional vector 

d = (d 0 , d u ■ ■ • (4.1) 

where dj , the j th effective free distance, is the lowest Hamming weight among all code 
sequences that are generated by input sequences with at least one ”1 ” in the j th 
position, i.e., 

d i = mjn {u>H(v [( M + Tn]) : vp,, t+m j = u [0 ,*].G,Vf} (4.2) 

where the j th bit of u, is non-zero for some s 6 [0, f], and u, = 0 for s > t. If 
an effective free distance vector d corresponding to a convolutional encoder with 
generator matrix G is such that its components are not mutually equal, then we call 
this encoder a linear unequal error protection convolutional code. It is evident from 
the previous definitions that the free distance of the code equals 

djrte = min {db, <fi, •••,<£*_!} (4.3) 

Thus, di ^ dfree • 

From the above definition, we have the following error-correcting capability of a 
convolutional code when used in a binary-input symmetric-output channel. An (n, k) 
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convolutional encoder, with generator matrix G and Viterbi or Sequential decod- 
ing algorithm, guarantees that the j th input information digit is decoded correctly 
whenever the error pattern has Hamming distance less than or equal to |_(dj — 1)/2J . 

Note that for a given memory distribution vector M = (mx,m 2 , , m*), and a 

given set of encoder matrices G t , each permutation of the k components of M and the 
corresponding rows of each G, leads to effective free distance vectors with components 

that are permutations of the set {d 0 , di, • • • , x}. Let d(C) = |d 0 , di, 5 dit-i} 

denote the vector formed by ordering the components of d in a nondecreasing order. 
An (n, fc, m) UEP convolutional encoder, G, with state complexity K and ordered 
effective free distance vector d(G) is optimum if there exists no other (n, k, m) UEP 
convolutional encoder, G' with state complexity K and ordered effective free distance 
vector d(G') which is larger (componentwise) than d(G). 

As an example, consider the (3,2) convolutional encoder with M = (1,1), and 
submatrices 


Go = 


0 1 0 
1 1 1 


;Gx = 


1 1 0 
1 0 1 


The encoder diagram and the associated trellis axe shown in Figs. 4.1, and 4.2, 


respectively. 

Examining the possible paths through the trellis reveals that the first effective free 
distance, d 0 , is 3, and the second effective free distance, di, is 4. That is, d = (3,4). 
The non-zero path through the trellis with weight 3 is shown by dotted lines. The 
non-zero paths with weight 4 are shown with dark lines. All other paths have weight 
greater than 4. It can be seen that the weight 3 path is created by an input vector 
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sequence that is non-zero only in the first input bit position, (01, 00). When the input 
sequences are non- zero in the second position, the minimum weight of any path is 4. 

It is important to recognize that the first “1” in the j th position does not necessarily 
occur at time zero. For instance, the input sequence (10 01 00) is one of the sequences 
that must be considered when determining the second effective free distance, d\, of 
an encoder with two input lines ( k = 2), and M = (1,1). On the other hand, the 
input sequence (10 10 00) does not affect d\. 

4.3 A Modified Transfer Function 

State diagram analysis has long been used to determine the transfer functions of 
low complexity (n, k , m) convolutional encoders. The transfer function, in turn, is 
then manipulated to determine the free distance, event error probability, and bit er- 
ror probability of the encoder. The bit error probability derived from the standard 
transfer function is the probability that an input bit is decoded incorrectly. How- 
ever, the error probability which is relevant for unequal error protection codes is the 
probability of bit error at each specific bit position. 

This section presents a modified transfer function analysis for time-invaxiant con- 
volutional encoders that yields the individual bit error probability for any specified 
input bit position. First, standard transfer function analysis will be briefly reviewed. 
Then, the modified transfer function will be described and illustrated with an ex- 
ample. An upper bound on the average bit error probability for a specific input bit 
position is presented. Then the unequal error protection capabilities of several codes 
are presented and discussed. 
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Recall that the two- variable transfer function of a code has the form 

T(X, Y) = g) f )A i4 X i Y\ (4.4) 

where is the number of code sequences with Hamming weight d that have corre- 
sponding (input) message sequences with Hamming weight b. The average bit error 
probability for a specific transfer function is bounded by 

ft(S)<;E BiPi, (4.5) 

K d 

where B d = J2b & 13 the tota ^ number of non-zero information bits associated with 

all codewords of weight d , and P d = (^/4p(l - p))*. For the sake of simplicity, we 
assume a binary symmetric channel with crossover probability p. 

When the individual bit error probability is desired for each of the k input po- 
sitions, then the split-.state diagram must be modified before Mason’s formula is 
applied. Each branch label has the new form 


X% ^Yj 1 


\r3k—\ 
X k-l J 


(4.6) 


where j q is equal to the input bit in the q th position, and i is the Hamming weight 
of the branch output. Obviously, the sum of the j q s is the Hamming weight of the 
input message block. The modified transfer function is then calculated in the same 
way described in [32]. The resulting modified transfer function is 


3d 


T(X,Y th Y u ---,Y t - l )= £ Y. c ^ xiY « ‘ Y '' J 


rh- 


l J 


(4.7) 


j=0 


where C d j is the number of paths associated with the j th input sequence distri- 
bution of l’s that generates code vectors of weight d, j d is the number of distinct 
input sequence distributions that generate code vectors of weight d , and the entity 
bvj, , bk-\,j represents a particular input sequence distribution of l’s. The 
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probability that a decoding error occurs for a bit located in the i tk position of a 
message block in the message sequence is then 


PP(E) < J2 B d ] PdforQ<i<k-l , (4.8) 

d 

where = Ej i 0 bjCdj is the total number of l’s in bit position i contained in ail 
input vectors that generate code vectors of weight d. Note that the new parameters 
are related to the original parameters by the equations Bd = E« B^ and Pb(E ) = 
(l/^EL'o 1 Pb'\E). In addition, the smallest d in the bound for P^\E) for which 
B ^ is non-zero is the effective free distance of the i th input position, d{. 

In Section 4.2, the effective free distance vector of the (3, 2) convolutional encoder 
with M = (1,1) and encoding matrices 


Go 


0 1 0 
1 1 1 


;Gx 


1 1 0 
1 0 1 


(4.9) 


was shown to be (3,4). The modified state diagram for the encoder is shown in Figure 
4.3. The modified transfer function is 


T(X,Y 0 ,Y 1 )= X 3 r 0 + 

X 4 (2 Y 0 Yi + Yq + YqY*)+ 

X 5 (Y, + 3 Y*Y X + 3 YoY* + F 0 3 + 3 Y 0 % 3 + 2 Y*Y? + r o 3 F 4 ) + 

(4.10) 

The transfer function indicates that there is one path of weight 3 through the 
trellis, and it is generated by the input sequence that has one 1 on line 0 and is zero 
on line 1. 

The bound for the probability of a bit error in the first input position is then 

p£°\E) < Pz + 6P4 + 3OP5 + Similarly, the bound for the probability of a bit 

error in the second input position is given by P^\E) < 4 P 4 + 27Ps -f 
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Consider the (3,2) convolutional encoder with M = (1,1) and encoding matrices 



1 0 1 
1 1 1 


;Gi 


0 1 1 

1 0 1 


(4.11) 


The encoder representation is shown in Figure 4.4, and the modified state diagram 
for the encoder is shown in Figure 4.5. The modified transfer function is 


T{X,Y 0 ,Y l )= X 3 {Y 0 Y 1 )+ (4.12) 

X 4 {Yo + Y 0 Y 1 2 + 2Y 0 2 Y 1 2 )+ 

X 5 (Kx + 2 Y 0 Y X + 3 Y*Y X + Y 0 Y 3 + 3 Y 0 2 Y 3 + 4F 0 3 y 3 ) + - - ■ 
and the effective free distance vector is (3,3). 

The encoder represented in (4.11) is equivalent to the encoder in (4.9). The 
difference in the effective free distance vectors demonstrates the dependence of the 
effective free distance on the encoder realization of the code. 

An obvious drawback of the state diagram analysis is the high level of complexity 
when the memory order and input vector dimension are not restricted to low val- 
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ues. As the total memory increases, the number of states increases exponentially. In 
addition, as the dimension of the input vector increases, the number of branches leav- 
ing each state increases exponentially. However, existing algorithms which attempt 
to reduce the computational complexity of calculating the transfer function can be 
modified to incorporate the additional information needed to determine the unequal 
error protection provided by the code. In addition, the same branch labels can be 
used in modifications of other algorithms [8] which were developed to determine the 
free distance vector of an encoder without calculating the transfer function. 

4.4 Two-Way Bounds 

In this section, a bound on the individual effective free distances is derived. 
Evaluating the bound is a useful tool in determining the unequal error protection 
capabilities of encoders of specified rate and memory distribution. In addition, it 
allows a comparison between the effective free distance of a specific encoder and the 
theoretically optimal effective free distance. First, a bound on the Hamming weight of 
the sum of two vectors with known Hamming weights is presented. Then this bound 
is applied to effective free distances and the implications are discussed. 

Let x and y be n-bit binary vectors and let z be the modulo 2 sum of x and y, 

z=(zi,z 2 , ,*n) • (4.13) 

= X ® y 

= (xi ® yi,x 3 ©y 2 , ,x„©y„) 

Assume that the Hamming weights of x and y are known and are w x and w y , 
respectively. It can be shown that the Hamming weight of z is upper bounded by the 
following relationship 
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w * < nun {n — w x , w y ) + min {n — w y , w x } . (4.14) 

The proof of the bound in (4.14) is given below. 

There are two cases which result in = 1 and which contribute to the Hamming 
weight of z. Case l occurs when x,- is 1 and y, is 0; Case 2 occurs when x; is O' and 
y% is 1. The Hamming weight of z is equal to the total number of bit positions in 
which either of the two cases appears. Therefore, w z can be upper bounded by the 
sum of the maximum number of occurrences of Case 1 and the maximum number of 
occurrences of Case 2. The number of bit positions in which Case 1 occurs can be 
no greater than the minimum of the number of 1 ’s in x and the number of 0’s in y. 
Similarly, the number of bit positions in which Case 2 occurs can be no greater than 
the minimum of the number of 0 s m x and the number of l*s in y. Therefore, 

w z < min {n — w x , w y } + min (n — w y , w x } . (4.15) 

The bound in (4.14) can be applied to a convolutional encoder and provides the 
basis for a bound on the effective free distance of a particular input line as a function 
of the effective free distance of another line. 

Recall that a rate R = k/n convolutional encoder with input (message) se- 
quence u = (u 0 ,U!, ), code sequence v = (vq.Vx, ), and memory distribution 

M (mo, nix, iin-k-i), with ttiq < mi — ...... < can be represented by the 

equation 


v j = Uj.Gq © Uj-x.Gx 0 © .G mk .„ (4.16) 

where u, is a binary k-tuple , v< is a binary n-tuple, and G< is a (ifc x n) binary matrix. 



41 


We will denote the encoding matrix, G, by the concatenation of the submatrices G,-, 
0 < * < that is, 

G = [G 0 [Gi| • • * |G. mfc _J (4.17) 

Because the effective free distance of input line j, dj, is the minimum Hamming 
weight of all codewords associated with input sequences that are non-zero on line j, 
the effective free distance of a particular input line is no larger than the Hamming 
weight, Wj, of the corresponding row in the encoding matrix G. In addition, from the 
definition of dj, we know that the Hamming weight of the binary sum of row i and 
row j is at least equal to dj, for all i ^ j, so that 

w(row(i) © row(j )) > dj. (4.18) 

Applying the bound of (4.14) to the bound of (4.18) yields an upper bound on dj 
in terms of to, and Wj, that is 


dj < w(row(i) © row(j )) < min + 1) — w,, Wj} + min {n(mfc_! + 1) — t Vj , to<} 

< [n(mjt_! + 1) - to,] + [n(m fc _i + 1) - tOj] 

= 2n(mk-\ + 1) — Wi — Wj. 

(4.19) 

The upper bound in (4.19) can be further manipulated to eliminate the dependence 
on a particular encoding matrix. The bound is loosened in the process, but it applies 
to any encoder with the same rate and memory distribution. 

Equation (4.19) can be rewritten as " • • 
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dj + Wj < 2n(m fe _i + 1) - Wi . (4.20) 

Since dj < Wj , the bound on dj can be loosened to 

2dj < 2 n(m fe _! + 1) - W{ (4.21) 

Similaxly, since d, < iu, , 


2d, < 2n(m / t_x + 1) - rf. 


(4.22) 


or 


dj < (1/2) [2n(m fc _! + 1) - d,] (4.23) 

The bound in (4.19) requires knowledge of the Hamming weights of rows i and j 
of the encoding matrix, whereas the bound in (4.23) presents a relationship between 
two effective free distances, regardless of the encoder. In addition, the bound in (4.23) 
can be used to compute the maximum possible value of an individual effective free 
distance when the minimum value of d, i.e. d/ ree , is known. 

To tighten the bound for encoders with unbalanced memory distributions, we 
consider input sequences constructed so that a periodic impulse of period vrij -f- 1 
enters each input line j. The original encoder has the encoder matrix 


G = [GolGxI'-- |G m(k _J 

r 0 

r i 

. r *-i . 


(4.24) 

(4.25) 
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Using the appropriate periodic input sequences, we can form two vectors 


and 


r'i = [Pijr,| . . . |r t ] 

' ' 

b times 


(4.26) 


Jr j | Tj | . . . |pj], (4.27) 

c times 

which are valid code sequences. 

Note that to- = uj# (r'i) = bw { and to' = to ff (r' ; -) = cwj. From the definition of 
the effective free distance, 


dj < w h (r'i © r'j). 


(4.28) 


Let N = n max [6(m, + 1), c(m : -f 1)]. From the vector bound in (4.14), 


wh( r'« © r'j) < min {iV — to,-, to'} 

+ min — to'-, to{} . 


So, 


(4.29) 

(4.30) 


Rewriting, 


or 


dj < min |iV — w[, to'} 

+ min { iV — to'-, toj} 
< [N - to'] + [JV - to'] 
= 2N — w'j — to'. 

dj + to' + to' < 2N 
dj + bw{ + cwj < 2 N. 


(4.31) 

(4.32) 

(4.33) 

(4.34) 

(4.35) 


(4.36) 
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Since d ] < Wj and di < tu,-, the bound can be loosened to 

bdi + (c + 1 )dj < 2 N = 2 n max [6(m,- + 1), c(mj + 1)] (4.37) 

When the number of information lines, i.e. k, is larger than 2, it is possible to 
repeatedly apply the two-way bounds to the effective distances. For instance, if k = 3, 
then the following bounds hold 

do + 2d x < 2n(m + 1) 

do + 2d 2 < 2 n(m + 1) (4.38) 

d\ + 2d 2 < 2n(m + 1), 

where m = max {mo, m x , m 2 }. The bounds are tightest when do>di, and d 2 are 
ordered so that do < dj < d 2 . Assuming such an ordering, do = dy ree , the largest 
possible value of d 2 is |(2n(m + 1) — d 0 ), which occurs when d x = d 0 = d/ ree . If the 
effective distance of line 1 is to be increased to do + a, then the maximum allowed 
value of d 2 is decreased to |(2n(m + 1) — d 0 — a). As an example, for a rate 3/4 
encoder with M = (1, 1, 1), if do is 2 and d x is 3, then the largest possible value of d 2 
is 6. In fact, when d 2 is 6, the bound permits values of do and d x up to 4. 

4.5 k-Way Bounds 

An alternative bound also applies to the effective free distances. The adv an tage of 
this bound is that is applies to more than two distances at one time. When jfc = 2, 
the following bound reduces to the bound in Equation (4.23). 

Again, assume that mo < ... < . No assumption on the relative sizes of the 

effective distances is necessary. 

The generator matrix forms a rate w ( mt * 1+x) block code with d = (d 0 , . . . , d]t_ x ). 
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It is obvious that 

do < n(m 0 + 1). (4.39) 

Because the generator matrix has at least one zero in each row, j, for which mj 0, 
the first equation of the k-way bound can be tightened slightly, to 

do < n(m 0 + 1) — 1. (4.40) 

Following the development of the Griesmer bound [17], rearrange the columns so 
that the first row has only ones in the first do positions, and only zeros in the remaining 
n(mjt_i + 1) — do positions. Several variables are useful in the bound development. 
We define y° as the number of l’s in the last n(mj + 1 ) — do positions of row j, s° as 
the number of l’s in the first d 0 positions of (row j ® row 0), and l : as the number 
of l’s in the first do positions of row j. 

Then for j = 1, . . . , k — 1, row j can have either: 
a) > rfl l’ 9 or 

b> > rf i o’ S 

in the first cf 0 positions. 

Situation a) implies than s*j < d 0 - f^]. Since w H (rowj ® rowO) > dj and 
Wff(rowj ® row 0) = s° + y° , 


Al 

+ 

o~» 

«0 

(4.41) 

do - r|l + y> > 3< j + y° > dj, 

(4.42) 

»? > is - - rfi). 

(4.43) 
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Since y° is obviously upperbounded by n(mj + 1) — do, 

dj - {do - |yl) < n{rrij + 1) - do 
or 

d : + lyl ^ «(™> + 1)- 

Allowing / = 1 and defining X x = [*], we have 


d\ + Xi < n{m-i + 1 ) 


( 4 . 44 ) 


( 4 . 45 ) 


( 4 . 46 ) 


for j = 1, . . . , k - 1. 

Because lj is the number of l’s in the first do positions of row j, and situation 
b) assumes that there are at least 0’s in the first do positions, this implies that 
0. Also, because the Hmming weight of row j is no less than dj, 


h + y° > dj . (4.47) 

or 

y° > d, - M> - r|i). (4.48) 

It then follows that 

d i + lyl < n(mj + 1). (4.49) 

This is the same as the result when situation a) is assumed. 

When the first row and the first do columns of the encoding matrix axe removed, 
we are left with a residual block code of rate n(m> witt d > (d x - (d 0 - 

■^i)> d 2 — (do — X \), . . . , dfc_i — (do — Xi)). To continue, we follow the same procedure 
as we did for the original block code That is, first rearrange the columns so that the 
first row has only ones in the first d\ — (do — Xi) positions, and only zeros in the 
remaining n(m*_ 1) — d 0 — ( di — (d 0 — Xi )) = n(m*_i) — d\—X 1 positions. Then for 



47 


j = 2, . . . , k — 1, the portion of the original row j that belongs to the residual code can 
have either: a) > l’s or b) > phrl^p£d'| 0’s in the first d x — (do — Xi) 

positions. 

Again, more variables are defined. Let yj be the number of l’s in the last n(my + 
1) — do — (di — (do — Xi)) positions of row j, sj be the number of l’s in the first 
di — (do — Xi) positions of row j ® row 1, and lj be the number of l’s in the first 
di — (do — positions of row j. 

Situation a) implies than s* < d x — (do — Xi) — Since wu(rowj ® 

tow\) > dj — (d 0 — Xi) and wjj(rowj ® row 1) = + y) > 

+ y) > dj — (d 0 — .Xi) (4.50) 

or 

y) > di - (* - Xi) - (di - (do - Xi) - r < *i - -fo-* l) 1) ) (4.51) 

or 

»?>d j -d, + r <il - ( V - l) i. (4.52) 

But y) < n(mj + 1) - d 0 — (d x — (d 0 — Xi)), so 

dj - d, + < „( mj + 1) _ d„ - (^ - (d„ - Xi)), (4.53) 

or 

r ^ " dj + X 2 + X\ < n{mj + 1), (4.54) 

where X 2 = ,for j = 2, . . . , k - 1. If j = 2, then 

d 2 + X 2 + X\ < n(m 2 + 1). (4.55) 


Situation b) implies similar results. 
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The process can be repeated for the residual block codes up to rate * — , — n — ^ 

n(mfc_j+X)— do— (di-(fl 

resulting in a set of k equations: 


do < n(m 0 + 1) — 1, 


(4.56) 


and 


for j = 1, . . . , k - 1, where X x = and X x = for / = 2, . . . k - 1. 

4.6 Plotkin-Type Bound 


dj +'22 Xi < n(rrij + 1 ) 


/=! 


(4.57) 


The Plotkin bound for block codes states that a code of length n with M codewords 
has minimum distance 


n 


- 2 1 -TJm' ^ 4 - 58 ) 

When the non-zero input to a convolutional encoder has length h, the encoder can 
be considered as a block code with 2** codewords of length h(m k -i + 1). Therefore, 
the free distance of the code may be upperbounded [30] by 


j ^ n{rn k - x + h) 2 hk , , „ 

djrtt < 2 2^ - 1 ’ h = 


(4.59) 


The effective distance for a specific input line, j, is the minimum Hamming weight 
among codewords that are associated with inputs that contain at least one 1 on that 
input line. A code generated by the inputs of length h which have at least one 1 on 
line j is called the restricted block code, Cj. The set of such inputs and outputs may 
be considered as a series of block codes, similar to the approach used for the Plotkin 
bound. We define Cj as the number of codewords in the restricted block code Cj. 
Then, Cj is equal to the total number of codewords in the unrestricted block code 


-Xx))-...- 
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with the same size input vectors minus the number of codewords that are all-zero on 
line j, or . ; 

Cj* = 2 hk - 2* ( * _1) (4.60) 


or 


C h = 2 M*-i)(2 a - i). 


(4.61) 


Then, using the bound in (4.59), dj is upper-bounded by 

n(m fc - 1 + /t) 2 A < fe ~ 1 )(2 /t - 1) _ 

aj ~ 2 2M*- 1 )(2*-l)-r ’ 


(4.62) 


for j = 0, • • • , k — 1. Note that each effective distance is subject to the same bounding 
value, i.e., the bound is independent of j. 


4.7 Another bound 


Another bound which applies to the effective free distance dj is quickly seen from the 
fact that the allowable inputs include the set of inputs which are all-zero on all lines 
that are not the line of interest. Therefore, 


dj < dopj (n , 1 , m j ) , (4.63) 

where d opt (n, 1 ,mj) is the optimal achievable free distance of the rate 1/n, memory 
rrij convolutional encoder. However, bound (4.63) is always looser than bound (4.62), 
making it useful only as a quick indication of the maximum possible effective distance 
vector. The bounds are applied to encoders of various rates and memory distributions 
in Tables 4.1 - 4.4. For each listed encoder configuration, the bounds on the effective 
distance vector for the given free distance are listed. The optimal (achieved) free 
distance, d opt is provided for reference. 
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Rate=2/3 

M 

dopt 

Bound 

Bound 

Bound 

Bound 



(4.23) 

(4.37) 

(4-57) 

(4.62) 

(i,i) 

3 

(3,4) 

(3,4) 

(3,4) 

(3,4) 

(1,2) 

4 

(4,7) 

(4,7) 

(4,7) 

(4,6) 



(3,8) 

(3,8) 

(3,7) 

(3,6) 

(2,2) 

5 

(5,6) 

(5,6) 

(5,6) 

(5,6) 



(4,7) 

(4,7) 

(4,7) 

(4,6) 



(3,7) 

(3,7) 

(3,7) 

(3,6) 


5 

(5,9) 

(5,7) 

(5,9) 

(5,8) 



(4,10) 

(4,8) 

(4,10) 

(4,8) 



(3,10) 

(3,9) 

(3,10) 

(3,8) 

(1,4) 

8 

(5,12) 

(5,10) 

(5,12) 

(5,9) 



(4,13) 

(4,11) 

(4,13) 

(4,9) 



(3,13) 

(3,12) 

(3,13) 

(3,9) 

(2,3) 

6 

(6,9) 

(6,9) 

(6,0) 

(6,8) 



(5,9) 

(5,9) 

(5,9) 

(5,8) 



(4,10) 

(4,10) 

(4,10) 

(4,8) 



(3,10 ) 

(3,10) 

(3,10) 

(3,8) 


Table 4.1: UEP bounds for Rate 2/3 Convolutional Encoders 

4.8 Results 

A non-exbaustive search for codes that meet these bounds was conducted. The FAST 
algorithm presented in [8] was used with the branch labeling method presented in Sec- 
tion 4.3 to determine the effective free distances. The search method stepped through 
successive possible encoding matrices, and immediately rejected encoders which con- 
tained a row with a Hamming weight less than the specified desired mini mum distance 
for the corresponding input line. In addition, the search algorithm rejected encoders 
which had taken too many” (typically steps along a path without increasing 

the Hamming weight of the output. Theoretically, this criterion may reject encoders 
that are not catastrophic and that have the desired effective free distance vector, but 
it greatly reduced search time. 

Tables 4.5 and 4.6 give the result for rate 2/3 and rate 2/4 encoders, respectively. 




Rate=2/4 

M 

dopt 

Bound 

Bound 

Bound 

Bound 



(4.23) 

(4.37) 

(4.57) 

(4.62) 

(M) 

5 

(5,5) 

(5,5) 

(5,5) 

(5,6) 



(4,6) 

(4,6) 

(4,6) 

(4,6) 

(1,2) 

6 

(6,9) 

(6,9) 

(6,9) 

(6,8) 



(5,9) 

(5,9) 

(5,9) 

(5,8) 



(4,10) 

(4,10) 

(4,10) 

(4,8) 

(2,2) 

7/8 

(8,8) 

(8,8) 

(8,8) 

(8,8) 



(7,8) 

(7,8) 

(7,8) 

(7,8) 



(6,9) 

(6,9) 

(6,9) 

(6,8) 



(5,9 ) 

(5,9) 

(5,9) 

(5,8) 

(1,3) 

7/8 

(7,12) 

(7,9) 

(7,12) 

(7,10) 



(6,13) 

(6,10) 

(6,13) 

(6,10) 



(5,13) 

(5,11) 

(5,13) 

(5,10) 



(4,14) 

(4,12) 

(4,14) 

(4,10) 



(3,14) 

(3,13) 

(3,14) 

(3,10) 

(1,4) 

8 

(7,16) 

(7,13) 

(7,16) 

(7,13) 



(6,17) 

(6,14) 

(6,17) 

(6,13) 



(5,17) 

(5,15) 

(5,17) 

(5,13) 



(4,18) 

(4,16) 

(4,18) 

(4,13) 



(3,18) 

(3,17) 

(3,18) 

(3,13) 

(2,3) 

8 

(8,12) 

(8,12) 

(8,12) 

(8,10) 



(7,12) 

(7,12) 

(7,12) 

(7,10) 



(6,13) 

(6,13) 

(6,13) 

(6,10) 



(5,13) 

(5,13) 

(5,13) 

(5,10) 



(4,14) 

(4,14) 

(4,14) 

(4,10) 



(3,14) 

(3,14) 

(3,14) 

(3,10) 


Table 4.2: UEP bounds for Rate 2/4 Convolutional Encoders 




Rate=2/5 

M 

d 0 pt 

Bound 

Bound 

Bound 

Bound 



(4.23) 

(4.37) 

(4.57) 

(4.62) 

(i,i) 

6 

(6J) 

(6,7) 

(6,7) 

(6,8) 



(5,7) 

(5,7) 

(5,7) 

(5,8) 



(4,8) 

(4,8) 

(4,8) 

(4,8) 

(1,2) 

9 

(9,10) 

(9,10) 

(9,10) 

(9,10) 



(8,11) 

(8,11) 

(8,11) 

(8,10) 



(7,11) 

(7,11) 

(7,H) 

(7,10) 



(6,12) 

(6,12) 

(6,12) 

(6,10) 



(5,12) 

(5,12) 

(5,12) 

(5,10) 

(2,2) 

9 

(10,10) 

(10,10) 

(10,10) 

(10,10) 



(9,10) 

(9,10) 

(9,10) 

(9,10) 



(8,11) 

(8,11) 

(8,11) 

(8,10) 



(7,11) 

(7,11) 

(7,11) 

(7,10) 



(6,12) 

(6,12) 

(6,12) 

(6,10) 



(5,12) 


(5,12) 

(5,10) 

(1,3) 

5 

(9,15) 

(9,11) 

(9,15) 

(9,13) 



(8,16) 

(8,12) 

(8,16) 

(8,13) , 



(7,16) 

(7,13) 

(7,16) 

(7,13) 



(6,17) 

(6,14) 

(6,17) 

(6,13) 



(5,17) 

(5,15) 

(5,17) 

(5,13) 

(1,4) 

8 

(9,20) 

(9,16) 

(9,20) 

(9,16) 



(8,21) 

(8,17) 

(8,21) 

(8,16) 



(7,21) 

(7,18) 

(7,21) 

(7,16) 



(6,22) 

(6,19) 

(6,22) 

(6,16) 



(5,22) 

(5,20) 

(5,22) 

(5,16) 

(2,3) 

6 

(13,13) 

(13,13) 

(13,13) 

(13,13) 



(12,14) 

(12,14) 

(12,14) 

(12,13) 



(11,14) 

(11,14) 

(11,14) 

(11,13) 



(10,15) 

(10,15) 

(10,15) 

(10,13) 



(9,15) 

(9,15) 

(9,15) 

(9,13) 



(8,16) 

(8,16) 

(8,16) 

(8,13) 



(7,16) 

(7,16) 

(7,16) 

(7,13) 



(6,17) 

(6,17) 

(6,17) 

(6,13) 



(5,17) 

(5,17) 

(5,17) 

(5,13) 


Table 4.3: UEP bounds for Rate 2/5 Convolutional Encoders 




Rate=3/4 

M 

dopt 

Bound 

(4.23) 

Bound 

(4.37) 

Bound 

(4.57) 

Bound 

(4.62) 


4 

(5,5,5) 

(5,5,5) 

(4,4,5) 

(4,5,5) 

(1,1,2) 

4 

(5.5.9) 

(4.4.10) 
(4,6,9) 

(5.5.9) 

(4.4.10) 
(4,6,9) 

(5.5.7) 
(4,4,9) 

(4.6.8) 

(5,8,8) 

(1,2,2) 

5 

(6.6.9) 
(6,8,8) 

(4.4.10) 

(6,6,9) 

(6.6.7) 

(4.7.7) 

(4.6.8) 
(4,4,10) 

(6,8,8) 

(2,2,2) 

6 

(6.6.9) 
(6,8,8) 

(4.4.10) 

(6.6.9) 
(6,8,8) 

(4.4.10) 

(6.6.7) 

(5.6.8) 

(4.4.9) 
(4,7,7) 

(6,8,8) 

(1,1,3) 

5 

(5.5.13) 

(4.4.14) 
(4,6,13) 

(5.5.11) 

(4.4.12) 
(4,6,10) 

(5.6.11) 
(5,8,10) 
(4,4,13) 

(4.6.12) 

(5,10,10) 

(1,2,3) 

6 

(7,8,12) 

(6,9,11) 

(7,8,9) 

(7.8.9) 

(7.7.10) 

(6.7.11) 
(6,9,10) 

(7,10,10) 


Table 4.4: UEP bounds for Rate 3/4 Convolutional Encoders 
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A primary goal of the searches was to find encoders with at least one effective distance 
greater than the free distance of the optimal code of the same rate and memory order. 
A decrease in free distance is acceptable. In Table 4.5, there are four instances in 
which the higher effective free distance is larger than the optimal free distance for 
rate 2/3 encoders with the same state complexity. For M = (1, 1), d = (3,4) , and 
d/ree = 3 for the time- invariant convolutional code, and d/ rec = 4 for the time- varying 
convolutional code as shown in [46]. Similarly, the optimal encoder for M = (1,1) 
[32] has an effective free distance vector d = (4,5). These two encoders are examples 
of encoders which provide unequal error protection while maintaining a free distance 
equal to the optimal free distance for the same rate and state complexity. Two 
encoders with state complexity 4 have one effective free distance vector d = (4,6). 
One has memory distribution M = (2,2), and the other has memory distribution 
M = (1,3). An encoder with d = (6,6) requires a state complexity of 5 [32], so 
allowing the protection of one bit to drop from am effective distance of 6 to an effective 
distance of 4 allows a reduction in the state complexity. The trellis associated with 
an encoder of state complexity 4 has 2 4 = 16 states, while the trellis associated with 
an encoder of state complexity of 5 has 2 s = 32 states. 

Table 4.6 shows several rate 2/4 encoders with one effective free distance that is 
larger than the optimal free distance for rate 1/2 encoders with the same rate and 
state complexity. Several are noted in the following discussion. For M = (1,2) the 
encoder with effective free distance d = (6, 7) increases the protection provided to 
one of the input bits. In comparison, the rate 1/2, M = 3 optimal encoder provides 
a free distance of 6 for all input bits, and a state complexity of 4 is required for 
a rate 1/2 encoder to provide a free distance of 7 to all input bits. The encoder 
that provides error protection d = (4,8) with M = (1,2) increases the effective 
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free distance on the second bit position by two, with the cost being a corresponding 
decrease in the effective free distance on the first bit. Note that the optimal rate 1/2 
encoder that provides a free distance of 8 requires a state complexity of 5. The encoder 
with M = (2, 2) and d = (8, 8) although not being a LUEP code, it is interesting 
because it achieves the free distance shown to be achievable by unit-memory codes 
[31], and both effective free distance exceed the free distance provided by the optimal 
rate 1/2, M = 4 encoder. The M = (1, 3) encoder with effective free distance vector 
d = (4, 9) provides protection to one of the bits which exceed the protection offered by 
even unit-memory codes of the same state complexity. The M = (2, 3) encoder with 
effective free distance vector d = (8, 9) is interesting because it provides unequal error 
protection while maintaining a free distance equal to the optimal value of 8. However, 
some encoders are obviously better choices for implementation. For instance, when 
the memory distribution is M = (1, 2), the encoder with d = (4, 8) is better than the 
encoder with d = (3,8). 

The tightest bounds for the effective free distances are listed in the tables. It can 
be seen that the derived bounds axe relatively tight when the memory distribution is 
balanced. The bounds appear to loosen as the memory increases and as the memory 
distribution becomes more unbalanced. The bounds also loosen as k increases. For 
example, the bound for rate 3/4, M = (1,1,1) encoders is looser than the bound for 
rate 2/4 M = (1, 1) encoders. 

Figures 4.6 - 4.33 show the bit error rate (BER) plots for the codes presented in 
Tables 4.5, 4.6, 4.9, using Viterbi decoding with soft decision decoding. Three sets 
of data points are shown in each plot. The data points described by the ’x’ tire the 
(simulated) bit error rate for input line 0. Similarly, the data points described by the 
’o’ axe the (simulated) bit error rate for input line 1. The overall BERs axe marked 



Rate=2/3 


d{bound) 


( 3 , 4 ) 
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5 3 0 
3 1 5 


(5,5) | 5 4 6 

3 5 3 


(1,3)1 5 


K3GM 1»M 

IWlMEU 




(5,7) (5,5) 3 7 0 0 

4 6 7 6 


(4,6) 6 3 0 0 

13 75 


(5,9) (5,6) 7 5 0 0 0 

5 1247 


(4,6) 3 5 0 0 0 
5 12 14 


(6,7) (6,6) 5 7 3 0 

3 15 5 


(5,8) (5,6) 15 6 0 

3 2 13 


(4,6) 4 2 5 

0 3 1 
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Rate= 

2/4 


M 

d op t 

d (bound) 

d 

G 

(1,1) 

5 

(5,5) 

(5,5) 

| 

| 

M 

6 

(6,8) 

(6,7) 

17 06 00 
06 12 15 


6 

(5,8) 

(5,7) 

07 06 00 
13 10 13 


6 

(4,8) 

(M) 

14 05 00 
07 17 13 

(2,2) 


(8,8) 


16 11 16 ' 
05 17 05 



(7,8) 

u 

1M 



(6,8) 

(6,8) 

01 07 03 
14 13 16 

(1,3) 


(7,9) 

(7,7) 

07 17 00 00 
10 11 15 03 



(6,10) 

(6,8) 

13 15 00 00 
15 13 01 13 



(5,10) 

(5,7) 

14 07 00 00 
17 02 01 16 



(4,10) 

(4,9) 

14 03 00 00 
07 11 01 16 



(3,10) 

(3,10) 

02 06 00 00 
15 13 01 13 

(1,4) 

8 

(7,13) 

(7,8) 

17 07 00 00 00 
06 13 01 14 12 


8 

(6,13) 

(6,10) 

16 13 00 00 00 
05 03 13 11 i5 


8 

(5,13) 

(5,9) 

11 07 00 00 00 
16 05 14 04 13 


8 

(4,13) 

(4,10) 

12 14 00 00 00 
17 15 04 07 13 


8 

(3,13) 

(3,12) 

10 06 00 00 00 
17 15 04 07 13 

(2,3) 

8 

(8,10) 

(8,9) 

05 17 05 00 
13 14 15 16 


8 

(7,10) 

(7,8) 

05 12 13 00 
13 06 15 07 


8 

(6,10) 

(6,8) 

01 03 07 00 
14 03 10 16 


8 

(5,10) 

(5,9) 

05 12 01 00 


13 06 07 14 


















































































Rat e= 2/5 


(7,10) 


(1,3) 12 (8,11) 


G 


13 26 
34 35 


07 37 00 
31 21 23 


15 17 00 
03 36 32 


(6,10) (6,10) 03 27 00 

35 32 24 


(9,10) (9,9) 33 01 17 

11 36 32 


(8,10) (8,10) 03 23 07 

11 36 32 


35 17 0 
26 32 1 


(7,10) 36 25 00 00 
33 04 15 13 


(6,11) 16 26 00 00 
33 04 15 13 


Table 4.7: Rate 2/5 UEP Convolutional Encoders 


Rate=3/4 


(0,1,2) 4 (4,4,9) (4,4,5) 17 00 00 

05 06 00 

03 04 03 

(3,3,9) (3,3,5) 03 00 00 

17 06 00 

04 17 12 


(1,2,2) 5 (5,6,7) (5,5,5) 11 17 00 

05 05 11 
03 04 03 

(4,4,10) (4,4,6) 01 

03 
16 


Table 4.8: Rate 3/4 UEP Convolutional Encoders 
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by ’*’s. For cases in which BER was lower than 10 -7 , data points do not appear. For 
comparison, the BER plots for the optimal free distance codes listed in [32] axe shown 
in Figures 4.34 - 4.42. The encoding matrices and effective free distance vectors for 
the optimal codes are listed in Table 4.9. 


(n,k) 

M 

d 

G 

(3,2) 

(i,i) 

(3,3) 

H 

(1,2) 

(4,5) 

5 3 0 
3 1 5 

(2,2) 

(5,5) 

kesh 

(2,3) 

(6,6) 

I 

(3,3) 

(7,7) 

BUM 

| £ 1 

(2,1) 

(2) 

(5) 

3 1 3 

mm 

nm 

3 3 13 

(4) 

(7) 

3 112 3 

(5) 

(8) 

321313 


Table 4.9: Optimal convolutional encoders 

Some observations about the BER plots for the UEP convolutional encoders follow. 
Examining Figure 4.7, it is seen that for the rate 2/3, M = (1,2) encoder, which has 
d = (4, 5), the BER for line 1 is lower for all SNRs than the BER for line 0, which was 
expected. The disparity in the protection offered to the two input positions increases 
as the SNR increases, similar to the manner in which the disparity in average BER 


for two codes with different free distances increases with increasing SNR. Every error 
probability for the rate 2/3, d = (4, 5) encoder is lower than the error probability 
for the optimal encoder, shown in Figure 4.35. The average BERs in Figure 4.7 are 
lower than the average BERs in Figure 4.8, which is expected for encoders which have 
effective distance vectors d = (4, 5) and d = (3, 5), respectively. In addition, although 
line 1 for both encoders have the same effective free distance of 5, the BER of line 1 in 
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Figure 4.7 is lower than the BER of line 1 in Figure 4.8. This phenomemon is seen in 
comparisons of other encoders, also. The phenomenon is possibly due to an increase 
in the number of codewords at each distance, so that while the effective distances are 
equal, the differences in multiplicities are large enough to affect the individual error 
rates. 

The rate 2/3, M = (2, 2) encoder with d = (4, 6) is an encoder which achieves 
an effective free distance on one line that is higher than the optimal free distance by 
reducing the effective free distance of the other line. Comparing the error rates in 
Figure 4.10 to the rates for the comparable optimal code in Figure 4.36, it is seen 
that, as expected, the optimal code has a lower average BER at every SNR. However, 
line 1 of Figure 4.10 has a significantly lower BER at 4 dB. 

The encoder analyzed in Figure 4.16 was constructed from a basic (2, 1,2) encoder, 
which can provide no unequal error protection [43]. The slight differences in the 
individual BERs for line 0 and line 1 at 3 dB and 4 dB are probably due to the 
limited number of information bits that were encoded and decoded in the simulation. 

The rate 2/4, M = (1,2), d = (6,7) encoder, when compared to the (2,1,3), 
free distance 6 optimal encoder, has a slightly lower average BER at 3 dB and 5 dB, 
with a slightly higher average BER at 4 dB. At 5 dB, the individuad bit error rate is 
significantly lower for line 0. 

The results in Figure 4.18 aire interesting. The protection on line 0 follows the 
standard curve shape, but the protection on line 1 has a non-standard from. The 
error rate on line 1 is lower than the average BER for the corresponding optimal 
code. 

It is interesting that the differences in the effective distance vectors of the rate 2 /4 
encoder with d = (8,8) and the corresponding optimal baisic code with dj Tee = 7 do 
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not correspond to significant differences in the BER plots. The error rates in Figure 
4.20 are lower, but the differences in the two plots do not indicate that the effective 
distance vectors are significantly different. This is an instance in which the number 
of low weight codewords is a significant factor, which can be seen from the transfer 
functions of the two encoders. The modified transfer function for the rate 2/4 encoder 
is 

T(X, Yq, Y x ) = X 8 (Y 0 +Y 1 +ZY 0 Y 1 +3Y 0 Y l 2 +Y 0 Y l 3 +Y 1 2 +2Y 2 Y l +Y 2 Y l 2 + Y 2 Y l *) + -- • . 

(4.64) 

On the other hand, the transfer function for the rate 1/2 encoder is 

t(x,y) = x 7 (y + r 3 ) + a- 8 (f 2 + y 4 ) + • ■ ■ . (4.65) 

The rate 1/2 encoder has a total of four code sequences of weight 8 or less, while the 
rate 2/4 encoder has fourteen code sequences of weight 8. 

The rate 2/4 encoder with d = (6,8) has lower BERs them those of the optimal 
encoder with df ree — 7, which is the desired effect. 

The BER plots illustrate the dependence of the probability of error on each input 
line on both the effective free distance and the nu mb er of codewords at that effective 
distance. The effective distance vector alone provides valid information about the 
disparity in unequal error protection, but the multiplicities provide additional useful 
information. 
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Figure 4.21: BER plot for R = 2/4, M = (2, 2) encoder with d = (7, 8) 
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SNR (E b /N 0 , dB) 

Figure 4.35: BER plot for optimal R = 2/3, M = (1,2) encoder with d = (4) 


4.9 Summary 

In this chapter, we examined the unequal error protection capabilities of convolu- 
W tional codes. The effective free distance vector is presented and defined as a measure 

^ the unequal error protection. Also, a modified transfer function for convolutional 
encoders from which the unequal error protection capabilities of a code can be cal- 
culated was defined. Several bounds on the unequal error protection capabilities of 
convolutional encoders were derived and discussed, and the results of searches for 
UEP codes were presented. It was shown that convolutional encoders can provide 
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Figure 4.36: BER plot for optimal R = 2/3, M = (2,2) encoder with d = (5) 



Figure 4.37: BER plot for 
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SNR (E s /N q , dB) 

Figure 4.42: BER plots for optimal R = 1/2, M = (5) encoder with d = (8) 

unequal error protection. Several encoders which provided more protection to one in- 
formation position than the protection offered by the optimal free distance encoder. 
The cost of the increased protection for a specific input line is typically a decrease in 
the protection offered to the other information bits. 
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CHAPTER 5 


Achieving Unequal Error 
Protection with Trellis Coded 
Modulation 


5.1 Introduction 


Traditional channel coding techniques achieve coding gain (i.e. reduce the required 
signal-to-noise ratio for a specified error probability) at the expense of the required 
bandwidth. For instance, a rate 1/2 code doubles the bandwidth relative to an 
uncoded transmission. Bandwidth expansion is often not possible on band-limited 
channels. Trellis coded modulation (TCM) was developed as a bandwidth efficient 
means to achieve coding gain [60]. 

Trellis coded modulation is a combined modulation and coding technique that 
can realize coding gains without increasing the required bandwidth. A finite state 
encoder, such as a convolutional encoder, determines the selection of the modulation 
signals and generates coded signal sequences. This chapter discusses the unequal error 
capabilities of TCM. Section 5.2 briefly review modulation techniques and describes 
trellis coded modulation. Search results for unequal error protection TCM codes are 
presented in Section 5.3. 


83 


84 


5.2 Trellis Coded Modulation 


Modulators convert a discrete signal into an analog waveform, for transmission 
over a channel. During each signaling interval, the modulator maps k bits into one 
of M = 2 k possible channel signals. The demodulation receives a corrupted version 
of the transmitted channel signal, and estimates the m original bits by choosing the 
channel signal which was closest to the received signal and performing the inverse 
mapping. 

Signal set representations for two amplitude modulation schemes are shown in 
Figures 5.1; two PSK signal constellations are shown in Figure 5.2. If the average 
signal energy is held constant, the signal points move closer together as the size of the 
signal set increases. Because a maximum likelihood demodulator chooses the channel 
signal closest to the received signal, more opportunities for errors occur for the larger 
signal set. 

♦ 1 • 

2-AM 



16-QAM 

Figure 5.1: Amplitude Modulation Signal Sets 
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Modulation and error-correction coding are performed independently, the results 
are mediocre. Consider the example presented in [61]. Both the 4-PSK modulation 
system without coding and the 8-PSK system with independent rate 2/3 convolutional 
coding transmit two information bits per modulation interval. The 8PSK system has 
a BER exceeding 10 2 when it is operated at the signal-to-noise ratio (SNR) for 
which the 4-PSK system exhibits a BER of 10~ 5 . The increased error rate is due to 
closer signal points in the 8 PSK constellation. The rate 2/3 code requires a state 
complexity of K = 6 to reduce the error rate of the 8PSK system to 10~ 5 . The 
convolutional code require a 64-state Viterbi decoder, which is fairly complex. That 
is, the 8PSK coded system is more complex and transmits no more reliably than the 
simpler 4PSK uncoded system. The difficulty in developing a simple, reliable system 
with independent coding and modulation led to the development pf TCM. 



Figure 5.3: A General TCM System 


Trellis coded modulation is a combined modulation and coding technique that can 
realize coding gains without increasing the required bandwidth. A finite state encoder, 
such as a convolutional encoder, determines the selection of the modulation signals 
and generates coded signal sequences. Figure 5.3 shows a general block diagram for a 
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TCM system which doubles the signal set. There axe k information bits entering the 
system, of which k bits enter the rate k/(k + 1) convolutional encoder, and (k — k) 
remain uncoded. 

Consider the rate 2/3 TCM coded 8PSK system with a 4-state, rate 1/2 convo- 
lutional encoder, which will be compared to an uncoded 4 PSK system. The 4 PSK 
signal space is shown in Figure 5.2; the labelled 8PSK signal space is shown in Figure 
5.4. 



It is possible to partition the signal set, which involves repeatedly dividing the 
signal set (or subset) into two smaller subsets with a larger smallest intra-set dis- 
tance, Si, where i is the number of times the partitioning has been conducted. . 
The partitioning for the 8PSK constellation is shown in Figure 5.5. The coded bits 
produced by the encoder select a subset, while the uncoded bit chooses a signal from 
the selected subset. The free Euclidean distance, d E of a TCM code is defined as the 
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minimum Euclidean distance between any two valid signal sequences, or 


4 = mm[£ I y* - y'n\ 2 ]> 

n 

where y n is the n th channel signal in the sequence. 



(5.1) 


Figure 5.5: Partitioning tin 8PSK Signal Set 


Assume the convolutional encoder has the trellis diagram shown in Figure 5.6. 
Then the trellis for the TCM code is aas shown in Figure 5.7. Parallel transitions 
occur on the trellis due to the uncoded input bit, and limit the free distance of the 
code. To offset this limitation, the signals associated with parallel transitions are 
assigned to the signal points that are most distant. In fact, the branch labels of the 
trellis for the convolutional code are assigned as signal set labels according to the 
three rules: 

a) Parallel transitions are associated with signals with the maximum Euclidean 
distance between them, 

b) Transitions exiting or entering a node in the trellis axe assigned to signal points 
with the next largest Euclidean distance between them, and 
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c) All signal points are used with equal frequency. 

The signal labels in Figure 5.4 were assigned according to the above rules. The 
sign ads assigned to the parallel transitions have Euclidean distance 2. On the other 
hand, any two signal sequences that have diverging paths in the trellis have at least 
Euclidean distance ^/Aq + Aj + Aq = ^Aq + A| = V4.585. Therefore, the free 
Euclidean distance of the code is 2. Since the free distance of the uncoded system 
in this example is y/2, the coded TCM system has a coding gain, in decibel (dB), of 

101 °s(($F) = 3dB - 



Figure 5.6: A 4-State Binary Trellis 



In general, the free Euclidean distance of a TCM code is the minimum of the 
minimum distance between parallel transitions and the minimum distance between 
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non-parallel paths through the trellis. Because linearity does not hold for TCM code 
sequences, the Euclidean distance between every pair of TCM signal sequences must 
be computed to determine the free distance if an unmodified trellis is used for the 
calculations. However, the reference path may be the all zero path if each binary 
branch label on the trellis is replaced with the minimum squared distance between 
all pairs of signal points with binary labels which differ by the value of the original 
branch label. With the modification, algorithms which are used to evaluate binary 
linear trellises may be used to determine the free Euclidean distance of a TCM code. 
This modification significantly simplifies the analysis of a TCM code. 

5.3 Unequal Error Protection with Trellis Coded 
Modulation 

When considering UEP with TCM, the free Euclidean distance vector is similar to 
the effective free distance vector for binary codes. The free distance vector for TCM is 
&E = (dEl , • • ■ , ^£ 2 ), where dgj is the minimum Euclidean distance between any two 
code sequences with input sequences that differ in the j th position. Combining the 
branch label modifications presented in Section 4.3 and Section 5.2, the free Euclidean 
distance vector of a specific encoder may be calculated with the same algorithms that 
calculate free distance and the effective free distance vector. 

The results for binary encoders may be used as guidelines for expected results 
for the TCM. A TCM code is represented by a trellis that is topologically identical 
to the binary trellis at the same rate and memory distribution. If the branches 
of the TCM trellis are to be labelled with the minimum distances associated with 
the all signal pairs with labels that differ by the encoder branch output, then the 
only differences between the two trellises are the weights assigned to the branches. 
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Furthermore, a given signal constellation, with a specified labeling or mapping, has a 
unique ordered set of minimum distances that are placed on the trellis. For example, 
consider the 8PSK constellation with natural mapping, shown in Figure 5.4. The 
minimum squared distances associated with the branch labels of the trellis are: 

label minimum squared 
branch distance 
000 " 0.000 
001 0.586 

010 0.586 

011 2.000 

100 0.586 

101 2.000 

110 4.000 

111 3.414 

Therefore, the ordered set of the minimum squared distances which replace the binary 
branch labels is {0.000, 0.586, 0.586, 0.586, 2.000, 3.414, 3.414, 4.000}. 


1000 

1101 

1100 

1001 

• 

• 

• 

• 

1111 

1010 

1011 

1110 

• 

• 

• 

• 

0100 

0001 

0000 

0101 

• 

• 

. • 


0011 

0110 

0111 

0010 

• 

• 

• ' 

• 


Figure 5.8: A Labeled 16QAM Signal Set 


Similarly, the 16QAM with standard mapping, shown in Figure 5.8 has the mini- 
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mum squared branch distances 


label minimum squared 
branch distance 


0000 0 
0001 1 

0010 2 

0011 5 

0100 4 

0101 1 

0110 2 

0111 1 

1000 8 

1001 5 

1010 2 

1011 1 

1100 4 

1101 5 

1110 2 

1111 5 


so the ordered set of branch distances is {0, 1, 1, 1, 1, 2, 2, 2, 2, 4, 4, 5, 5, 5, 5, 8}. 

The ordered set of branch distances for a binary encoder is equal to the (ordered) 
Hamming weights of the binary branch labels. So then, the ordered set of distances 
for a rate k/3 binary encoder is { 0,15 1,1,2,2,2,3}, and the ordered set of branch 
distances for a rate k/4 binary encoder is {0, 1, 1, 1, 1, 2, 2, 2, 2, 2, 2, 3, 3, 3, 3, 4}. 

The maximum possible free Euclidean distance vector for a specific TCM code 
with a certain signal mapping and memory distribution may be calculated from the 
trellis of the optimal UEP binary convolutional encoder of the same configuration. 
The free Euclidean distance vector for a specific TCM is no larger than the effec- 
tive distance vector of the optimal UEP binary encoder, evaluated with its branch 


distances replaced by the minimum mapping distances of the signal set that occupy 
the same relative place in the ordered set of distances. That is, the ordered branch 
distances for the labelled constellation are aligned with the ordered branch distances 
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for the binary encoder, and then are assigned as the branch distances on the the 
trellis. When the trellis for the optimal UEP binary encoder is evaluated with the 
new branch labels, the effective squared Euclidean distance of the system with the 
most advantageous branch labeling is found. The resulting free Euclidean distance 
vector is not necessarily achievable, nor is necessarily achievable with the encoder 
that is the optimal binary encoder. Instead, the resulting effective distance vector 
is the distance that would be achieved for a constellation mapping with the given 
set of squared Euclidean branches, mapped so that the smallest squared Euclidean 
distance is aligned with the smallest Hamming weight, etc. It is possible that with 
the same constellation mapping, a different encoder may be found that produces the 
same effective distance vector. 



Figure 5.9: Alternative Labeling for an 8PSK Signal Set . 

It is hypothesized here that the natural mapping for the 8PSK signal constellation 
and the typical 16QAM mapping produce the largest ordered sets of branch distances 
among all possible mappings. That is, rearranging the mapping so that one or more 
of the values in the set is reduced is not accompanied by an increase in another 
value that offsets the original reduction. Conversely, increasing one value in the set 
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Rate=2/3, 8PSK 

M 

uncoded 

bits 

di 

(0,1) 

1 

(2.586,2.586) 

<i.i) 

0 

(3.172,3.172) 

(0,2) 

1 

(4.0,4.586) 

(0,3) 

0 

(4.0,5.172) 

(1,2) 

(1,2) 

0 

(4.586,4.586) 

0 

(4.0,5.172) 

(2.2) 

0 

(5.172,5.172) 


Table 5.1: Unequal Error Protection with 8PSK TCM 

causes a decrease in another value that is at least as large in magnitude. As an 
example, consider the 8PSK constellation with the mapping shown in Figure 5.9. 
The minimum squared distance between all pairs of signals with labels that differ 
by 001 was increased from .586 to 2.0, when compared with the natural mapping 
shown in Figure 5.4. However, not only was the minimum squared distance between 
all pairs of signals with labels that differ by 010 decreased from 2.0 to .586, but 
the minimum squared distance between all pairs of signals with labels that differ by 
011 was reduced to from 3.414 to .586. Non-exhaustive searches for signal mappings 
with a larger (componentwise) ordered set of minimum distances than the standard 
mappings for the 8PSK constellation or the 16QAM constellation were conducted. 
None were found, leading to the the conclusion that the standard mappings possess 
the largest ordered sets of branch distances. 

The results of searches for 8PSK systems with unequal error protection are shown 
in Table 5.1. A criterion of the search was that at least one effective squared Eu- 
clidean distance must be larger than the corresponding effective free distance of the 
typical system. The components of the distance vectors listed in Table 5.1 are the 
squared values. Similarly the results of searches for 8PSK systems with unequal er- 
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Rate=2/4, 16QAM 

M 

uncoded 

bits 


(0,1) 

0 

(6,6) 

1 

(5.6) 

1 

(4,7) 

(i.i) 

0 

(9,9) 

0 

(8,10) 

(0.2) 

0 

(8,10) 

(1.2) 

0 

(ii,ii) 

0 

(7,10) 


Table 5.2: Unequal Error Protection with 16QAM TCM 


ror protection are shown in Table 5.2. The components in the vectors listed for the 


16QAM results axe the unnormallized, squared distances. 

5.4 Summary 

Trellis coded modulation systems with 8PSK and 16QAM were examined as potential 
UEP coding systems. It was shown that the free Euclidean distance vector of a TCM 


system can be upper bounded if the signal mapping and the optimal UEP binary 
code of the appropriate configuration are known. However, the results were scaxce, 
due to the limitations of the signal sets. 




CHAPTER 6 


Conclusions and 
Recommendations for Future 
Research 


The unequal error protection capabilities of convolutional encoders were investigated. 
The effective free distance vector, d, was defined as an alternative to the free distance 
as a primary performance parameter for UEP convolutional encoders. It was shown 
that, although the free distance for a code is unique to the code and independent 
of the encoder realization, the effective distance vector is dependent on the encoder 
realization. 

A modified transfer function, which provides a method to calculate d, was pre- 
sented. The modified transfer function developed a new branch labeling method 
that allows standard algorithms that were originally developed to calculate the free 
distance of a code to calculate the effective distance vector. 

Several upper bounds on d were derived. The bounds indicate that convolu- 
tional encoders with unbalanced memory distributions may provide more pronounced 
unequal error protection than encoders with balanced memory distributions. The 
bounds are evaluated and compared. The results of searches for good unequal error 
protection codes are presented. Both balanced and unbalanced memory allocation 
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configurations axe examined. A primary goal of the searches was to find encoders 
with at least one effective distance greater than the free distance of the optimal code 
of the same rate and memory order. A decrease in free distance was acceptable. A 
number of binary convolutional encoders meeting the goal were listed. Bit error rate 
(BER) plots for the encoders were presented, and confirmed the effective distance as 
a measure of unequal error protection. At the same time, the BER plots show that 
the number of code sequences with Hamming weights equal to the individual effective 
distance is more important than expected. 

Extensions to trellis coded modulation were examined. It was found that providing 
unequal error protection with TCM coding is difficult due to the limitations of the 
signal constellations. However, it was shown that the optimal binary UEP encoder 
provides information about the maximum possible free Euclidean distance for a TCM 
code with the same configuration. 

Topics for future study are now identified. Because the effective distance is de- 
pendent on the encoder realization, and because k > 1 for UEP encoders, ways to 
reduce the search space would be extremely useful. For instance, tighter bounds on 
the effective distance vector would better identify encoder configurations with UEP 
potential. It is possible that the approach used to developed bound (4.37) may be ap- 
plied to the k - way bound of (4.57), resulting in a tighter bound. Identifying features 
common to good UEP encoders would also help focus searches. 

Extensions of the results to trellis coded modulation are limited for the 8PSK and 
16QAM systems, due in part to the restrictive nature of the constellations themselves. 
It is possible that larger standard, as well as nonstandard, constellations will have 
enough flexibility to provide unequal error protection with TCM. 

Similarly, multi-dimensional codes may have unequal error protection capabilities. 



98 


In particular, it is possible that altering the signal set partitioning developed in [48] 
will bring about unequal error protection to the information bits. 



Figure 6.1: A Concatenated UEP System 


An example of another configuration which holds promise as an UEP coding sys- 
tem is the multi-level concatenated system shown in Figure 6.1. Although specific 
rates are shown in the figure, the rates are unspecified for the general system. It 
is expected that the information bits which enter the first encoder will have larger 
effective distances than the information bits which pass through only one encoder. 
Furthermore, the disparity in error protection may be enhanced by choosing appro- 
priate UEP binary encoders codes. A simplified decoding algorithm for a system 
similar to the one in Figure 6.1 would be important. 

Providing unequal error protection with binary convolutional encoders and trellis 
coded modulation remains a viable area of research. 
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